-- Logs begin at Thu 2022-05-19 11:16:47 UTC, end at Thu 2022-05-19 12:50:39 UTC. -- May 19 12:14:21.841253 dv-cinder-778193-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 12:14:21.848858 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 12:14:21.851999 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 12:14:21 2022] *** May 19 12:14:21.851999 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 12:14:21.851999 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 12:14:21.851999 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: nodename: dv-cinder-778193-27-iscsi May 19 12:14:21.851999 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: machine: x86_64 May 19 12:14:21.851999 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: clock source: unix May 19 12:14:21.851999 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: pcre jit disabled May 19 12:14:21.851999 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: detected number of CPU cores: 4 May 19 12:14:21.851999 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: current working directory: / May 19 12:14:21.851999 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: detected binary path: /usr/bin/uwsgi-core May 19 12:14:21.852583 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: your processes number limit is 47680 May 19 12:14:21.852583 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: your memory page size is 4096 bytes May 19 12:14:21.852583 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: detected max file descriptor number: 2048 May 19 12:14:21.852583 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: lock engine: pthread robust mutexes May 19 12:14:21.852583 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: thunder lock: enabled May 19 12:14:21.852583 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 12:14:21.852583 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 12:14:21.898661 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: Python main interpreter initialized at 0x55dbc8bf99c0 May 19 12:14:21.898661 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: python threads support enabled May 19 12:14:21.898661 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: your server socket listen backlog is limited to 100 connections May 19 12:14:21.898661 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: your mercy for graceful operations on workers is 90 seconds May 19 12:14:21.899070 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: mapped 403077 bytes (393 KB) for 2 cores May 19 12:14:21.899070 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: *** Operational MODE: preforking *** May 19 12:14:21.899348 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: *** uWSGI is running in multiple interpreter mode *** May 19 12:14:21.899348 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: spawned uWSGI master process (pid: 103656) May 19 12:14:21.899554 dv-cinder-778193-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 12:14:21.902355 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: spawned uWSGI worker 1 (pid: 103657, cores: 1) May 19 12:14:21.902355 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: spawned uWSGI worker 2 (pid: 103658, cores: 1) May 19 12:14:21.902355 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 12:14:23.132939 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 12:14:23.152370 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 12:14:23.903198 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:14:23.903198 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: from cryptography.utils import int_from_bytes May 19 12:14:23.903522 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:14:23.903522 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: from cryptography.utils import int_from_bytes May 19 12:14:23.919239 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:14:23.919239 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: from cryptography.utils import int_from_bytes May 19 12:14:23.919680 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:14:23.919680 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: from cryptography.utils import int_from_bytes May 19 12:14:26.533401 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 12:14:26.533987 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 12:14:26.534178 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 12:14:26.534570 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 12:14:26.534830 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 12:14:26.535224 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.535545 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.535866 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.536183 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.536514 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.536824 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.537143 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.537469 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.537808 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.538051 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.538362 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.538711 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-778193-27-iscsi {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.539031 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.539337 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.539648 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.539963 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.540268 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.540588 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.540893 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.541411 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.541822 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.542127 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.542460 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.542802 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.543117 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.543424 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.543744 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.544050 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.544372 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.544678 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.545074 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-778193-27-iscsi {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.545535 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.545683 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.545992 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.546416 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.547001 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.547311 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.547410 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 12:14:26.547806 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 12:14:26.547892 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.547982 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.548120 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 12:14:26.548240 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.548578 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 12:14:26.548718 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.548961 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.549283 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.549387 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 12:14:26.549597 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.549773 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.549893 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.550105 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.550201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.550439 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.550530 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.550763 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.550850 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.551095 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.551190 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.551402 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.551488 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.551653 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.551757 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.551960 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.552045 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.552280 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.552373 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.552576 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.552670 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.552964 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.553068 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.553151 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.553282 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-778193-27-iscsi {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.553372 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.553516 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.553686 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.553820 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.554004 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.554126 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.554311 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.563310 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.563537 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.563537 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.563758 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.563849 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.563936 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.564553 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.564553 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.564718 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.564797 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.564797 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.564797 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.565151 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.565243 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.565330 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.565464 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.565464 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.565611 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.565686 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.565761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.565761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.565967 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.565967 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.566113 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.566187 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.566321 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.566424 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.566565 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.566647 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.566768 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.566848 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.566976 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.567057 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.567140 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.567217 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.567299 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-778193-27-iscsi {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.567382 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.567461 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.567543 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.567628 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.567712 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.567870 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.567961 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.568111 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.568192 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.568266 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.568350 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.568426 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.568506 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.568506 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.568643 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.568717 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.568799 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.568875 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.568988 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.569084 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.569168 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.569244 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.569327 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.569405 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.569479 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.569554 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.569554 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.569554 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.569765 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.569841 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.569922 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.569999 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.570078 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.570161 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.570238 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.570312 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.570385 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.570532 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.570629 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.570715 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.570792 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.570873 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.570989 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.571072 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.571148 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.571232 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.571308 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.571382 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.571456 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.571529 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.571602 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.571687 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.571763 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.571763 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.571918 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.571994 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.572076 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.572191 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.572275 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.572351 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.572424 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.572499 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.572582 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.572659 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.572740 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.572816 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.572890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.572971 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.573055 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.573132 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.573206 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.573279 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.573350 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.573479 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.573576 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.573661 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.573737 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.573811 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.573885 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.573966 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.574042 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.574116 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.574197 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.574272 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.574346 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.574346 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.574536 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.574615 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.574690 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.574764 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.574843 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.574965 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.575052 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.575264 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.575362 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.575567 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.575651 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.575864 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.575957 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.576180 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.576267 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.576487 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.576579 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.576789 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.576875 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.577363 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.577460 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.577665 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.577763 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.577980 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.578071 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.578295 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.578395 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.578552 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.578643 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.578836 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.578983 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.579137 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.579297 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.579450 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.579624 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.580291 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.580494 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.580809 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.581105 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.581217 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.581416 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.581507 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.581720 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.581813 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.582025 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.582120 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.582327 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.582439 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.582653 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.582753 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.582956 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.583055 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.583258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.583344 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.583558 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.583642 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.583859 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.583952 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.584161 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.584245 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.584461 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.584544 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.584775 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.584873 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.585088 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.585181 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.585387 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.585470 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.585689 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.585775 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.585990 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.586089 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.586290 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.586374 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.586628 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.586721 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.586928 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.587024 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.587227 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.587312 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.587542 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.587628 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.587844 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.587929 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.588145 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.588236 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.588458 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.588544 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.588759 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.588843 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.589061 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.589144 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.589372 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.589466 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.589668 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.589758 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.589968 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.590066 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.590280 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.590401 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.590606 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.590691 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.590907 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.591004 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.591205 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.591290 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.591510 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.591604 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.591808 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.591899 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.592105 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.592194 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.592402 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.592486 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.592700 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.592792 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.592994 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.593088 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.593308 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.593398 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.593616 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.593710 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.593920 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.594011 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.594224 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.594315 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.594555 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.594666 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.594862 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.594953 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:14:26.595165 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.595281 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.595511 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.595837 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.595966 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.596143 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.596315 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.596475 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.596634 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.596773 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.596962 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.597077 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.597291 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.597381 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.597608 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.597705 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.597918 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.598012 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.598231 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.598327 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.598580 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.598684 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.598883 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.598977 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.599189 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.599299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.599497 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.599594 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.599798 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.599886 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.600108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.600204 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.600420 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.600512 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.600715 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.600810 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.601023 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.601127 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.601328 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.601416 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.601636 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.601722 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.601943 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.602037 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.602251 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.602340 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.602589 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.602702 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.602893 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.602991 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.603201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.603288 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.603534 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.603627 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.603846 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.603944 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.604148 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.604234 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.604464 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.604550 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.604770 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.604858 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.605073 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.605226 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.605375 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.605491 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.605681 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.605770 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.605980 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.606067 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.606286 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.606388 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.606608 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.606699 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.606911 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.606998 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.607212 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.607306 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.607513 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.607604 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.607814 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.607896 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.608115 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.608200 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.608416 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.608510 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.608737 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.608824 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.609043 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.609147 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.609341 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.609423 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.609642 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.609750 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.609943 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.610044 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.610247 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.610335 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.610571 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.610660 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.610873 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.611002 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.611345 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.611671 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.611879 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.611974 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.612192 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.612291 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.612505 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.612607 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.612812 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.612912 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.613127 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.613222 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.613451 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.613545 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.613754 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.613857 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.614085 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.614185 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.614385 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.614506 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.614714 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.614801 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.615021 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.615109 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.615326 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.615412 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.615626 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.615724 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.615934 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.616021 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.616235 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.616320 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.616534 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.616628 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.616854 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.616941 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.617160 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.617248 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.617460 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.617560 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.617777 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.617865 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.618076 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.618163 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.618373 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.618522 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.618703 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.618790 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.619008 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.619094 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.619313 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.619410 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.619614 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.619700 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.619918 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.620005 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.620223 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.620311 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.620530 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.620624 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.620834 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.620922 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.621153 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.621245 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.621459 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.621553 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.621766 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.621851 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.622066 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.622153 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.622377 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.622530 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.622710 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.622829 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.623009 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.623107 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.623315 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.623409 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.623616 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.623712 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.623916 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.624004 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.624219 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.624319 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.624522 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.624620 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.624820 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.624915 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.625120 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.625205 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.625420 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.625517 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.625719 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.625807 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.626019 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.626105 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.626323 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.626445 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.627211 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.627338 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.627516 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.627829 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.627937 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.628135 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.628234 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.628437 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.628524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.628738 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.628843 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.629046 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.629133 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.629366 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.629452 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.629672 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.629771 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.629990 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.630078 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.630308 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.630393 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.630635 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.630723 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.630937 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.631027 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.631256 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.631342 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.631564 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.631652 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.631867 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.631954 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.632168 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.632262 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.632470 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.632595 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.632777 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.632863 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.633093 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.633179 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.633396 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.633482 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.633708 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.633794 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.634013 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.634107 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.634320 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.634456 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.635463 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.635560 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.635644 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.635731 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.635812 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.635889 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.635889 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.636037 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.636249 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.636523 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.636610 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.636839 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.636930 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.637146 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.637234 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.637522 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.637627 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.637759 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.637856 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.638064 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.638159 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.638368 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.638477 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.638696 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.638784 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.639009 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.639105 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.639315 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.639403 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.639621 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.639707 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.639924 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.640028 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.640231 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.640318 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.640530 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.640623 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.640841 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.641104 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.641202 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.641433 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.641547 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.641746 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.641833 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.642063 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.642153 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.642994 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.643316 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.643403 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.643651 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.643739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.643977 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.644063 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.644343 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.644490 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.644631 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.644727 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.644938 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.645025 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.645248 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.645375 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.645552 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.645660 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.645858 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.645953 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.646159 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.646251 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.646485 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.646598 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.646793 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.646879 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.647097 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.647182 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.647397 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.647490 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.647697 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.647781 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.647995 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.648079 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.648299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.648393 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.648607 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.648704 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.648907 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.648990 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.649215 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.649301 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.649514 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.649598 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.649816 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.649900 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.650129 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.650213 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.650448 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.650536 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.650753 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.650845 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.651051 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.651138 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.651357 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.651443 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.651679 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.651769 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.651987 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.652079 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.652288 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.652374 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.652599 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.652692 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.652917 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.653016 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.653301 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.653401 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.653558 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.653654 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.653862 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.653948 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.654164 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.654257 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.654491 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.654666 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.654810 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.654958 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.655095 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.655240 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.655388 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.655523 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.655657 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.655789 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.655960 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.656103 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.656247 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.656382 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.656561 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.656698 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.656845 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.656978 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.657134 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.657269 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.657438 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.657571 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.657735 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.657865 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.658075 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.658376 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.658596 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.658689 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.658931 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.659033 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.659281 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.659500 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.659587 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.659835 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.659922 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.660155 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.660251 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.660464 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.660552 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.660767 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.660854 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.661072 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.661184 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.661374 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.661477 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.661679 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.661773 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.661985 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.662072 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.662286 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.662382 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.662629 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.662715 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.662937 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.663042 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.663247 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.663400 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.663561 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.663695 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.663837 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.663932 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.664137 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.664221 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.664435 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.664520 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.664740 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.664832 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.665036 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.665128 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.665337 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.665428 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.665636 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.665722 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.665937 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.666022 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.666235 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.666317 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.666554 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.666642 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.666852 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.666936 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.667149 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.667235 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.667446 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.667532 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.667744 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.667829 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.668043 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.668133 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.668340 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.668431 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.668634 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.668725 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.668953 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.669046 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.669253 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.669337 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.669551 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.669644 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.669849 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.669948 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.670147 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.670233 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.670508 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.670602 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.670809 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.670907 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.671125 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.671219 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.671429 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.671774 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.671985 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.672078 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.672283 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.672367 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.672587 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.672678 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.672888 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.672984 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.673185 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.673314 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.673549 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.673663 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.673926 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.674313 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.674400 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.674658 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.674801 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.674977 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.675072 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.675279 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.675363 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.675589 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.675682 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.675895 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.675982 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.676203 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.676294 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.676509 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.676594 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.676812 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.676899 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.677116 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.677215 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.677434 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.677528 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.677729 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.677815 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.678029 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.678115 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.678329 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.678520 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.678652 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.678746 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.678957 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.679047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.679258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.679351 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.679561 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.679651 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.679863 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.679948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.680167 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.680259 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.680471 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.680555 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.680771 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.680857 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.681076 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.681173 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.681385 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.681470 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.681687 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.681778 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.681987 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.682082 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.682290 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.682377 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.682613 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.682708 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.682916 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.683006 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.683217 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.683315 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.683530 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.683624 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.683839 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.683947 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.684138 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.684270 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.684442 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.684580 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.684742 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.684890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.685041 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.685208 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.685341 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.685518 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.685645 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.685827 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.685942 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.686142 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.686226 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.686474 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.686564 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.686779 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.686875 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.687117 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.687201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.687435 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.687521 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.687739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.687824 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.688037 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.688130 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.688338 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.688424 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.688634 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.688719 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.688950 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.689545 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.690009 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.690297 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.690391 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.690637 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.690721 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.690941 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.691028 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.691263 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.691347 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.691565 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.691654 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.691885 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.691971 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.692197 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.692284 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.692510 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.692594 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.692816 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.692908 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.693130 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.693280 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.693437 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.693589 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.693746 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.693897 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.694048 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.694215 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.694350 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.694574 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.694691 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.694897 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.694984 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.695200 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.695284 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.695512 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.695597 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.695821 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.695907 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.696144 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.696229 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.696467 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.696563 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.696776 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.696862 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.697079 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.697170 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.697380 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.697465 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.697686 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.697770 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.698003 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.698087 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.698311 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.698396 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.698643 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.698728 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.698953 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.699049 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.699260 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.699344 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.699566 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.699651 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.699870 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.699964 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.700175 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.700259 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.700480 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.700571 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.700782 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.700879 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.701102 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.701187 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.701414 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.701499 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.701716 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.701815 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.702020 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.702112 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.702320 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.702424 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.702654 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.702741 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.702957 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.703042 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.703262 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.703382 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.703568 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.703690 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.703874 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.703998 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.704198 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.704304 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.704513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.704658 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.705397 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.705710 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.705919 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.706033 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.706246 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.706353 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.706589 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.706679 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.706897 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.706982 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.707374 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.707482 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.707643 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.707733 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.707877 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.707972 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.708179 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.708273 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.708496 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.708589 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.708798 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.708884 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.709107 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.709205 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.709427 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.709514 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.709731 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.709817 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.710028 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.710121 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.710326 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.710432 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.710665 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.710752 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.710966 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.711064 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.711283 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.711370 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.711604 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.711734 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.711909 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.711996 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.712210 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.712303 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.712516 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.712673 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.712816 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.712980 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.713118 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.713285 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.713589 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.713742 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.713835 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.714011 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.714103 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.714315 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.714426 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.714641 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.714747 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.714948 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.715033 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.715249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.715332 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.715567 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.715652 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.715872 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.715955 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.716173 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.716258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.716473 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.716559 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.716772 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.716857 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.717092 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.717184 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.717393 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.717479 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.717702 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.717786 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.718019 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.718112 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.718335 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.718439 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.718686 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.718782 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.718997 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.719095 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.719320 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.719411 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.719634 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.719719 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.719948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.720041 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.720265 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.720410 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.720649 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.720963 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.721048 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.721277 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.721364 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.721590 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.721674 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.721899 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.721993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.722210 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.722303 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.722545 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.722635 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.722860 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.722958 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.723166 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.723402 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.723495 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.723734 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.723867 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.724048 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.724143 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.724349 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.724443 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.724665 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.724752 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.724972 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.725059 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.725282 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.725365 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.725591 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.725683 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.725891 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.725984 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.726199 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.726284 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.726524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.726624 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.726826 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.726920 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.727125 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.727210 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.727425 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.727524 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.727762 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.727855 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.728062 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.728148 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.728379 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.728478 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.728689 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.728786 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.729000 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.729085 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.729308 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.729397 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.729635 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.729721 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.729936 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.730020 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.730247 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.730340 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.730580 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.730668 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.730902 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.731000 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.731200 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.731285 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.731501 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.731588 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.731809 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.731948 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.732107 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.732193 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.732405 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.732498 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.732703 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.732797 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.733006 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.733091 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.733302 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.733394 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.733601 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.733697 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.733899 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.733984 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.734214 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.734300 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.734532 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.734621 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.734853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.734946 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.735154 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.735241 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.735452 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.735690 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.735775 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.736035 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.736358 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.736571 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.736786 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.736922 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.737113 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.737227 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.737429 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.737559 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.737747 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.737875 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.738073 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.738191 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.738377 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.738548 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.738708 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.738836 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.739019 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.739157 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.739326 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.739471 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.739628 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.739783 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.739949 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.740093 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.740258 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.740402 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.740560 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.740713 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.740878 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.741022 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.741185 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.741331 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.741634 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.741733 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.741948 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.742043 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.742316 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.742420 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.742659 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.742743 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.743028 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.743175 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.743344 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.743502 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.743650 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.743814 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.743972 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.744124 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.744282 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.744432 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.744585 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.744742 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.744898 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.745054 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.745206 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.745369 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.745508 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.745667 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.745810 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.745980 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.746100 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.746286 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.746437 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.746631 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.746733 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.746949 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.747040 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.747271 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.747360 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.747603 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.747701 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.747913 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.748012 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.748217 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.748306 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.748519 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.748616 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.748825 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.748917 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.749123 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.749213 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.749423 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.749524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.749726 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.749813 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.750028 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.750116 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.750335 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.750457 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.750662 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.750751 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.750973 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.751103 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.751268 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.751356 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.752088 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.752193 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.752496 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.752813 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.752947 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.753167 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.753262 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.753490 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.753578 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.753794 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.753896 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.754100 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.754208 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.754433 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.754524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.754747 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.754835 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.755068 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.755161 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.755376 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.755474 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.755683 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.755778 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.756006 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.756097 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.756323 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.756521 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.756837 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.756922 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.757168 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.757306 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.757485 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.757578 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.757805 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.757890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.758117 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.758202 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.758442 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.758543 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.758756 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.758843 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.759060 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.759153 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.759362 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.759457 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.759671 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.759763 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.759978 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.760063 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.760276 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.760374 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.760582 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.760676 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.760888 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.760981 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.761190 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.761277 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.761496 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.761587 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.761799 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.761884 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.762104 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.762329 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.762444 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.762715 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.762801 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.763022 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.763118 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.763335 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.763427 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.763649 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.763757 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.763959 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.764046 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.764260 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.764346 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.764577 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.764662 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.764877 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.765007 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.765179 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.765266 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.765488 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.765585 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.765795 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.765880 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.766104 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.766189 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.766421 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.766520 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.766731 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.766819 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.767034 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.767145 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.767986 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.768413 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.768534 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.768728 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.768825 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.769048 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.769134 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.769368 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.769462 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.769685 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.769770 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.769990 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.770081 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.770296 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.770383 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.770629 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.770728 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.770936 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.771050 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.771233 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.771324 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.771535 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.771623 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.771837 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.771930 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.772145 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.772230 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.772454 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.772547 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.772762 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.772862 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.773078 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.773220 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.773398 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.773538 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.773707 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.773843 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.774022 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.774152 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.774330 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.774530 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.774665 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.774852 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.774968 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.775158 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.775258 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.775462 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.775558 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.775776 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.775862 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.776083 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.776216 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.776400 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.776497 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.776709 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.776795 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.777006 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.777088 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.777307 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.777401 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.777608 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.777695 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.777907 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.778160 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.778254 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.778512 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.778621 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.778823 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.778909 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.779124 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.779217 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.779426 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.779511 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.779726 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.779812 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.780025 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.780119 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.780324 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.780417 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.780892 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.780993 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.781075 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.781155 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.781238 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.781465 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.781559 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.781646 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.781826 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.781916 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.782131 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.782225 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.782466 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.782569 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.782787 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.782936 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.783218 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.783613 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.783718 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.783840 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.784069 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.784164 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.784452 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.784589 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.784707 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.784804 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.785022 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.785109 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.785340 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.785478 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.785653 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.785746 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.785960 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.786045 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.786286 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.786466 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.786625 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.786730 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.786928 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.787020 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.787235 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.787319 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.787558 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.787666 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.787851 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.787944 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.788158 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.788244 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.788467 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.788551 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.788807 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.788893 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.789092 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.789232 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.789387 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.789531 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.789701 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.789830 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.790008 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.790171 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.790348 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.790505 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.790655 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.790741 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.790980 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.791075 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.791303 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.791457 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.791670 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.791756 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.792028 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.792123 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.792355 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.792474 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.792664 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.792769 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.792987 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.793083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.793315 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.793400 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.793648 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.793733 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.793968 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.794055 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.794271 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.794357 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.794596 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.794730 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.794898 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.794994 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.795141 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 12:14:26.795262 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.795581 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.795887 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.796188 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.796488 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.797049 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.797350 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.797691 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.797994 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.798294 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.799741 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.800060 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.800371 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.800684 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.800993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.801298 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.801603 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.801917 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.802221 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.802555 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.802861 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.803168 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.803468 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.803801 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.804134 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.804448 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.804768 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.805084 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.805401 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.805708 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.806025 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.806343 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.806686 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.806993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.807323 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.807631 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.807938 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.808246 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.808553 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.808858 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.809165 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.809488 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.809810 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.810111 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.810455 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.810770 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.811090 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.811403 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.811713 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.812040 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.812347 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.812659 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.812970 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.813275 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.813580 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.813891 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.815659 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.816713 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.817061 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.817387 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.817738 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.818072 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.818446 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.818774 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.819124 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.819455 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.819773 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.820088 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.820396 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:14:26.820644 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103657) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 12:14:26.856191 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO dbcounter [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Registered counter for database nova_api May 19 12:14:26.878538 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_db.sqlalchemy.engines [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:14:26.882267 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO dbcounter [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] Registered counter for database nova_api May 19 12:14:26.885141 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writer thread running {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:14:26.902906 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG oslo_db.sqlalchemy.engines [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:14:26.910168 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG dbcounter [-] [103657] Writer thread running {{(pid=103657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:14:26.942575 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.context [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),265c6b0e-6307-4ee8-8365-0ad79f4145cf(cell1) {{(pid=103658) load_cells /opt/stack/nova/nova/context.py:464}} May 19 12:14:26.948206 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:14:26.949778 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:14:26.950595 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:14:26.952556 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:14:26.954549 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO dbcounter [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Registered counter for database nova_cell0 May 19 12:14:26.958675 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO dbcounter [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Registered counter for database nova_cell1 May 19 12:14:26.966084 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_db.sqlalchemy.engines [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:14:26.967552 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_db.sqlalchemy.engines [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:14:26.975159 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.context [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),265c6b0e-6307-4ee8-8365-0ad79f4145cf(cell1) {{(pid=103657) load_cells /opt/stack/nova/nova/context.py:464}} May 19 12:14:26.975358 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writer thread running {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:14:26.976893 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writer thread running {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:14:26.980731 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG oslo_concurrency.lockutils [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:14:26.982306 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG oslo_concurrency.lockutils [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:14:26.983130 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG oslo_concurrency.lockutils [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:14:26.985072 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG oslo_concurrency.lockutils [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103657) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:14:26.988243 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO dbcounter [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] Registered counter for database nova_cell0 May 19 12:14:26.992334 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO dbcounter [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] Registered counter for database nova_cell1 May 19 12:14:26.999357 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG oslo_db.sqlalchemy.engines [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:14:27.001070 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG oslo_db.sqlalchemy.engines [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:14:27.007134 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG dbcounter [-] [103657] Writer thread running {{(pid=103657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:14:27.010129 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG dbcounter [-] [103657] Writer thread running {{(pid=103657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:14:27.125359 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO dbcounter [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Registered counter for database nova_cell0 May 19 12:14:27.134874 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_db.sqlalchemy.engines [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:14:27.139283 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writer thread running {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:14:27.163716 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO dbcounter [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] Registered counter for database nova_cell0 May 19 12:14:27.172793 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG oslo_db.sqlalchemy.engines [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103657) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:14:27.178334 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG dbcounter [-] [103657] Writer thread running {{(pid=103657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:14:27.570979 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: WARNING keystonemiddleware.auth_token [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:14:27.578570 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: WARNING keystonemiddleware.auth_token [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:14:27.604484 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: WARNING keystonemiddleware.auth_token [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:14:27.613134 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: WARNING keystonemiddleware.auth_token [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:14:27.924460 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: WARNING keystonemiddleware.auth_token [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:14:27.930633 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: WARNING keystonemiddleware.auth_token [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:14:27.935859 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dbc8bf99c0 pid: 103658 (default app) May 19 12:14:27.937933 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:14:27.939168 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001764 May 19 12:14:27.939592 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Thu May 19 12:14:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:14:27.958997 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: WARNING keystonemiddleware.auth_token [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:14:27.965156 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: WARNING keystonemiddleware.auth_token [None req-9a814f18-ef6c-455c-a934-09ec47fecd0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:14:27.970975 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dbc8bf99c0 pid: 103657 (default app) May 19 12:15:51.958113 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:15:51.959189 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 May 19 12:15:51.959961 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:15:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:15:51.973743 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG dbcounter [-] [103657] Writing DB stats nova_api:SELECT=3 {{(pid=103657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:51.975077 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG dbcounter [-] [103657] Writing DB stats nova_cell1:SELECT=3 {{(pid=103657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:51.975811 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG dbcounter [-] [103657] Writing DB stats nova_cell0:SELECT=3 {{(pid=103657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:51.976572 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG dbcounter [-] [103657] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:52.422865 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-80797089-10c3-4302-b66f-219706a81d0e admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:15:52.457779 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-80797089-10c3-4302-b66f-219706a81d0e admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.489323 May 19 12:15:52.458695 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1291 bytes} [Thu May 19 12:15:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:15:54.779296 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:15:54.780965 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-39030c63-bf57-4e84-9158-5cc5f8ed39ad None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002043 May 19 12:15:54.781403 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:15:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:15:54.847216 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-f0a4cb70-97f6-43f9-b35d-5cf02aebcf03 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:15:54.865069 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:54.865069 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: warnings.warn(msg) May 19 12:15:54.969719 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-f0a4cb70-97f6-43f9-b35d-5cf02aebcf03 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.182013 May 19 12:15:54.970283 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1282 bytes} [Thu May 19 12:15:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:15:54.983965 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writing DB stats nova_api:SELECT=3 {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:54.984942 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writing DB stats nova_cell0:SELECT=3 {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:54.986063 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writing DB stats nova_cell1:SELECT=3 {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:54.986942 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:15:55.193432 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-02824fa3-29fc-4697-b0cd-54f70d066079 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:15:55.195824 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:55.195824 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: warnings.warn(msg) May 19 12:15:55.344562 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-02824fa3-29fc-4697-b0cd-54f70d066079 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.366088 May 19 12:15:55.345156 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1335 bytes} [Thu May 19 12:15:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:15:57.892283 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-f0a4cb70-97f6-43f9-b35d-5cf02aebcf03 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:15:57.893314 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-f0a4cb70-97f6-43f9-b35d-5cf02aebcf03 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 May 19 12:15:57.893884 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:15:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:15:58.041160 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-8ad0215b-6940-489b-a01e-853f665bef95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:15:58.061850 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:58.061850 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: warnings.warn(msg) May 19 12:15:58.241322 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-8ad0215b-6940-489b-a01e-853f665bef95 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.338525 May 19 12:15:58.243876 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1282 bytes} [Thu May 19 12:15:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:15:58.258421 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-885a4c05-9d12-42a8-80e4-055d2e7c82a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:15:58.260177 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:15:58.260177 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: warnings.warn(msg) May 19 12:15:58.402201 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-885a4c05-9d12-42a8-80e4-055d2e7c82a2 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.147895 May 19 12:15:58.403123 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1335 bytes} [Thu May 19 12:15:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:16:00.759216 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-8ad0215b-6940-489b-a01e-853f665bef95 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:00.760235 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-8ad0215b-6940-489b-a01e-853f665bef95 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 May 19 12:16:00.760671 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:16:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:00.828142 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-435413ba-9709-4ebd-aee0-1d7277014d5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:00.900960 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-435413ba-9709-4ebd-aee0-1d7277014d5f admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131235 May 19 12:16:00.901920 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1282 bytes} [Thu May 19 12:16:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:16:00.915270 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-58fcaf41-438d-4ebc-844d-f7ded4ee0ee0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:01.014314 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-58fcaf41-438d-4ebc-844d-f7ded4ee0ee0 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102814 May 19 12:16:01.028586 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1335 bytes} [Thu May 19 12:16:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:16:03.391453 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-435413ba-9709-4ebd-aee0-1d7277014d5f admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:03.392475 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-435413ba-9709-4ebd-aee0-1d7277014d5f admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 19 12:16:03.392879 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:16:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:03.456957 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-5d8dd26b-826c-43ab-a231-c9668dba9213 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "id": "d3", "ram": 2048}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:03.602261 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-5d8dd26b-826c-43ab-a231-c9668dba9213 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.193442 May 19 12:16:03.602261 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1282 bytes} [Thu May 19 12:16:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:16:03.604977 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-7fc50475-e110-475a-a2e7-fe44ef9201d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:03.716234 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-7fc50475-e110-475a-a2e7-fe44ef9201d6 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108701 May 19 12:16:03.716234 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1335 bytes} [Thu May 19 12:16:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:16:06.027672 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-5d8dd26b-826c-43ab-a231-c9668dba9213 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:06.028354 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-5d8dd26b-826c-43ab-a231-c9668dba9213 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001675 May 19 12:16:06.028941 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:16:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:06.091360 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-601b676f-b913-4619-b390-dffc877e1c51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:06.268331 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-601b676f-b913-4619-b390-dffc877e1c51 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.232711 May 19 12:16:06.269230 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1282 bytes} [Thu May 19 12:16:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:16:06.282119 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-4bd5cb6f-e41e-4f5d-820b-f585f589f88b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:06.475583 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-4bd5cb6f-e41e-4f5d-820b-f585f589f88b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.197960 May 19 12:16:06.476408 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1335 bytes} [Thu May 19 12:16:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:16:09.127794 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-601b676f-b913-4619-b390-dffc877e1c51 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:09.128822 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-601b676f-b913-4619-b390-dffc877e1c51 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 19 12:16:09.129423 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:16:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:09.204801 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-58d6c6f3-39fa-41fe-bff7-63954e7a005a admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:09.232926 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-58d6c6f3-39fa-41fe-bff7-63954e7a005a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.096925 May 19 12:16:09.233589 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1291 bytes} [Thu May 19 12:16:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:16:11.883917 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-601b676f-b913-4619-b390-dffc877e1c51 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:11.885890 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-601b676f-b913-4619-b390-dffc877e1c51 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001668 May 19 12:16:11.885890 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:16:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:11.967500 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-e9b6c99c-0b33-4208-ab9a-9b8c3168c9fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "disk": 1, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "1"}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:12.080589 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-e9b6c99c-0b33-4208-ab9a-9b8c3168c9fc admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.187808 May 19 12:16:12.081503 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1282 bytes} [Thu May 19 12:16:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 12:16:12.102714 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-be41b2d5-a757-413c-8ea4-e2d2ea2cdbba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:12.213938 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-be41b2d5-a757-413c-8ea4-e2d2ea2cdbba admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118909 May 19 12:16:12.214750 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1332 bytes} [Thu May 19 12:16:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:16:15.646530 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-e9b6c99c-0b33-4208-ab9a-9b8c3168c9fc admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:15.647844 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-e9b6c99c-0b33-4208-ab9a-9b8c3168c9fc admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 May 19 12:16:15.650444 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:16:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:15.717292 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-a01bc7b3-0e84-4596-80b5-917070273d29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "swap": 0, "name": "m1.small", "id": "2", "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:15.827950 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-a01bc7b3-0e84-4596-80b5-917070273d29 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.172387 May 19 12:16:15.828580 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1282 bytes} [Thu May 19 12:16:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:16:15.840532 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-bc100f85-a26c-4ffc-ab94-32926699e259 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:16.226004 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-bc100f85-a26c-4ffc-ab94-32926699e259 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.389096 May 19 12:16:16.227620 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1332 bytes} [Thu May 19 12:16:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:16:18.637893 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-a01bc7b3-0e84-4596-80b5-917070273d29 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:18.638958 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-a01bc7b3-0e84-4596-80b5-917070273d29 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 May 19 12:16:18.639376 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:16:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:18.708058 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-6605f9dc-b17a-484d-aa04-f1004619d3ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "disk": 40, "swap": 0}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:18.842754 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-6605f9dc-b17a-484d-aa04-f1004619d3ec admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.196924 May 19 12:16:18.843212 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1282 bytes} [Thu May 19 12:16:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:16:18.854930 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-427ec009-e216-4c68-a531-0fbccd5c0cd7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:18.978328 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-427ec009-e216-4c68-a531-0fbccd5c0cd7 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127008 May 19 12:16:18.979120 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1332 bytes} [Thu May 19 12:16:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:16:21.303955 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-6605f9dc-b17a-484d-aa04-f1004619d3ec admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:21.304979 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-6605f9dc-b17a-484d-aa04-f1004619d3ec admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 May 19 12:16:21.305455 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:16:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:21.375184 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-bef4bcb2-cc43-4003-a465-5e3958b19b09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "swap": 0, "disk": 80}} {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:22.375467 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG dbcounter [-] [103657] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:16:22.382172 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-bef4bcb2-cc43-4003-a465-5e3958b19b09 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.070246 May 19 12:16:22.382988 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1282 bytes} [Thu May 19 12:16:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:16:22.395303 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-a6aab903-e39e-4ec1-8000-82f7479c46d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:22.527375 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-a6aab903-e39e-4ec1-8000-82f7479c46d0 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135741 May 19 12:16:22.528072 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1332 bytes} [Thu May 19 12:16:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:16:24.958813 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-bef4bcb2-cc43-4003-a465-5e3958b19b09 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:24.959832 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-bef4bcb2-cc43-4003-a465-5e3958b19b09 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 May 19 12:16:24.960275 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:16:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:25.028721 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-5468478c-7e80-4191-8c17-f6987821b2a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 160, "ram": 16384, "rxtx_factor": 1.0, "id": "5", "name": "m1.xlarge"}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:25.123588 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-5468478c-7e80-4191-8c17-f6987821b2a2 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.153586 May 19 12:16:25.129551 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1282 bytes} [Thu May 19 12:16:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:16:25.138042 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-c0241448-cdff-498f-a8b7-ae760a6cf7c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:25.269684 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-c0241448-cdff-498f-a8b7-ae760a6cf7c4 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136538 May 19 12:16:25.270372 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1332 bytes} [Thu May 19 12:16:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:16:47.796459 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-5468478c-7e80-4191-8c17-f6987821b2a2 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:47.797691 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-5468478c-7e80-4191-8c17-f6987821b2a2 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001706 May 19 12:16:47.798318 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:16:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:47.858152 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-628a53d9-3b5d-4509-9d69-a62137ac19ba admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:47.876383 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-628a53d9-3b5d-4509-9d69-a62137ac19ba admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071281 May 19 12:16:47.877019 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1291 bytes} [Thu May 19 12:16:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:16:48.905466 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-5468478c-7e80-4191-8c17-f6987821b2a2 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:48.906572 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-5468478c-7e80-4191-8c17-f6987821b2a2 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 May 19 12:16:48.907069 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Thu May 19 12:16:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:49.131303 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-bd11930a-b3d7-4625-bcd9-f8ebbec882bc admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:49.136871 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.wsgi [None req-bd11930a-b3d7-4625-bcd9-f8ebbec882bc admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-bd11930a-b3d7-4625-bcd9-f8ebbec882bc admin admin] Request method failure captured: May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Accept: application/json May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Accept-Encoding: gzip, deflate May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Connection: keep-alive May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Content-Length: 0 May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Host: 10.222.0.57 May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Openstack-Api-Version: compute 2.90 May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Openstack-System-Scope: None May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: User-Agent: python-novaclient May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Auth-Token: gAAAAABihjUwIFtJC34U0HKwloJ1ItA0uIKhTORKW8NapUq1Bxo1vtthMZG72eOYahh9FwNcZoMHXST3bg1kZNMzN-_HswcqEjOfAg3VKWIkFrFsbZHZaluNa9mZbTs5boLv_7vpTpL7Ei_UDkyjGE-CGemGMuXxcasDyn0wvJZYlmX-fbiCrzs May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Domain-Id: None May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Domain-Name: None May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Identity-Status: Confirmed May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Is-Admin-Project: True May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Openstack-Nova-Api-Version: 2.90 May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Project-Domain-Id: default May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Project-Domain-Name: Default May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Project-Id: 67ffb05dd43a48979db84b48835b3e07 May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Project-Name: admin May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Role: admin,reader,member May 19 12:16:49.140141 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Roles: admin,reader,member May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_67ffb05dd43a48979db84b48835b3e07", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Tenant: admin May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Tenant-Id: 67ffb05dd43a48979db84b48835b3e07 May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Tenant-Name: admin May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User: admin May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User-Domain-Id: default May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User-Domain-Name: Default May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User-Id: 87e06b5266a1425fb48c02407f951f73 May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User-Name: admin May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: method: > May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: exception: Flavor 42 could not be found. May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: action_args: {'id': '42'} May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:16:49.141761 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:16:49.142739 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:49.144336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-bd11930a-b3d7-4625-bcd9-f8ebbec882bc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:16:49.145505 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-bd11930a-b3d7-4625-bcd9-f8ebbec882bc admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063087 May 19 12:16:49.145505 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Thu May 19 12:16:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 12:16:49.151555 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-d9d465ec-9700-4984-874e-f0450e709e96 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:49.154547 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:16:49.174961 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-d9d465ec-9700-4984-874e-f0450e709e96 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026924 May 19 12:16:49.175562 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Thu May 19 12:16:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:16:49.185159 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-dfa5655b-62d3-4495-b271-c6d2701231f5 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:49.209590 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-dfa5655b-62d3-4495-b271-c6d2701231f5 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026988 May 19 12:16:49.209590 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Thu May 19 12:16:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:16:49.220320 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-87d78c46-6567-41f8-b1b0-d3673f50e944 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:49.227318 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.wsgi [None req-87d78c46-6567-41f8-b1b0-d3673f50e944 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-87d78c46-6567-41f8-b1b0-d3673f50e944 admin admin] Request method failure captured: May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Accept: application/json May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Accept-Encoding: gzip, deflate May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Connection: keep-alive May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Content-Length: 0 May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Host: 10.222.0.57 May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Openstack-Api-Version: compute 2.90 May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Openstack-System-Scope: None May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: User-Agent: python-novaclient May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Auth-Token: gAAAAABihjUwIFtJC34U0HKwloJ1ItA0uIKhTORKW8NapUq1Bxo1vtthMZG72eOYahh9FwNcZoMHXST3bg1kZNMzN-_HswcqEjOfAg3VKWIkFrFsbZHZaluNa9mZbTs5boLv_7vpTpL7Ei_UDkyjGE-CGemGMuXxcasDyn0wvJZYlmX-fbiCrzs May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Domain-Id: None May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Domain-Name: None May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Identity-Status: Confirmed May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Is-Admin-Project: True May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Openstack-Nova-Api-Version: 2.90 May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Project-Domain-Id: default May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Project-Domain-Name: Default May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Project-Id: 67ffb05dd43a48979db84b48835b3e07 May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Project-Name: admin May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Role: admin,reader,member May 19 12:16:49.230614 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Roles: admin,reader,member May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_67ffb05dd43a48979db84b48835b3e07", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Tenant: admin May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Tenant-Id: 67ffb05dd43a48979db84b48835b3e07 May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Tenant-Name: admin May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User: admin May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User-Domain-Id: default May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User-Domain-Name: Default May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User-Id: 87e06b5266a1425fb48c02407f951f73 May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User-Name: admin May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: method: > May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: exception: Flavor 42 could not be found. May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: action_args: {'id': '42'} May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:16:49.232299 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:16:49.233083 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:49.234201 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-87d78c46-6567-41f8-b1b0-d3673f50e944 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:16:49.239933 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-87d78c46-6567-41f8-b1b0-d3673f50e944 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016177 May 19 12:16:49.239933 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Thu May 19 12:16:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 12:16:50.138325 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-dfa5655b-62d3-4495-b271-c6d2701231f5 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:50.139370 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-dfa5655b-62d3-4495-b271-c6d2701231f5 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 19 12:16:50.139767 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Thu May 19 12:16:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:50.345619 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-e0b0c107-2dfb-4e51-a7b6-d172b85228d3 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:50.351476 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.wsgi [None req-e0b0c107-2dfb-4e51-a7b6-d172b85228d3 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-e0b0c107-2dfb-4e51-a7b6-d172b85228d3 admin admin] Request method failure captured: May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Accept: application/json May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Accept-Encoding: gzip, deflate May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Connection: keep-alive May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Content-Length: 0 May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Host: 10.222.0.57 May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Openstack-Api-Version: compute 2.90 May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Openstack-System-Scope: None May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: User-Agent: python-novaclient May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Auth-Token: gAAAAABihjUyxt_Jz_lG1rDk4ftErHvcCiUycYEN7dsaV-rBe9iMnoZiUx1Ip5gaJJZv_lkpCFW0CW2cQPgFAHAqUC2ZePhq88O1GFgDnFDJHGoWS_gZTjEZA3rrhvs0egxlnVWfD8-DI3iys4eERLw1XIpglVRKuourtJqxuP2Hrh6eu2cHP0k May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Domain-Id: None May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Domain-Name: None May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Identity-Status: Confirmed May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Is-Admin-Project: True May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Openstack-Nova-Api-Version: 2.90 May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Project-Domain-Id: default May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Project-Domain-Name: Default May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Project-Id: 67ffb05dd43a48979db84b48835b3e07 May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Project-Name: admin May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Role: admin,reader,member May 19 12:16:50.352921 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Roles: admin,reader,member May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_67ffb05dd43a48979db84b48835b3e07", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Tenant: admin May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Tenant-Id: 67ffb05dd43a48979db84b48835b3e07 May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Tenant-Name: admin May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User: admin May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User-Domain-Id: default May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User-Domain-Name: Default May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User-Id: 87e06b5266a1425fb48c02407f951f73 May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User-Name: admin May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: method: > May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: exception: Flavor 84 could not be found. May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: action_args: {'id': '84'} May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:16:50.354453 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:16:50.360762 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:50.361978 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-e0b0c107-2dfb-4e51-a7b6-d172b85228d3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:16:50.363253 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-e0b0c107-2dfb-4e51-a7b6-d172b85228d3 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.073823 May 19 12:16:50.363253 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Thu May 19 12:16:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 12:16:50.365011 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-f16f116e-37d5-4f80-b4d1-8788f8ce6a42 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:50.379077 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-f16f116e-37d5-4f80-b4d1-8788f8ce6a42 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017924 May 19 12:16:50.379604 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Thu May 19 12:16:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:16:50.388842 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-820e25bf-a738-4653-8c5d-6f1369c1fae7 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:50.403179 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-820e25bf-a738-4653-8c5d-6f1369c1fae7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017746 May 19 12:16:50.403707 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Thu May 19 12:16:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:16:50.413586 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-62148b07-4226-4799-bf1e-22e3b78a819b admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:50.419030 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.wsgi [None req-62148b07-4226-4799-bf1e-22e3b78a819b admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-62148b07-4226-4799-bf1e-22e3b78a819b admin admin] Request method failure captured: May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Accept: application/json May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Accept-Encoding: gzip, deflate May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Connection: keep-alive May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Content-Length: 0 May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Host: 10.222.0.57 May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Openstack-Api-Version: compute 2.90 May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Openstack-System-Scope: None May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: User-Agent: python-novaclient May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Auth-Token: gAAAAABihjUyxt_Jz_lG1rDk4ftErHvcCiUycYEN7dsaV-rBe9iMnoZiUx1Ip5gaJJZv_lkpCFW0CW2cQPgFAHAqUC2ZePhq88O1GFgDnFDJHGoWS_gZTjEZA3rrhvs0egxlnVWfD8-DI3iys4eERLw1XIpglVRKuourtJqxuP2Hrh6eu2cHP0k May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Domain-Id: None May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Domain-Name: None May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Identity-Status: Confirmed May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Is-Admin-Project: True May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Openstack-Nova-Api-Version: 2.90 May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Project-Domain-Id: default May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Project-Domain-Name: Default May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Project-Id: 67ffb05dd43a48979db84b48835b3e07 May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Project-Name: admin May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Role: admin,reader,member May 19 12:16:50.420524 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Roles: admin,reader,member May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_67ffb05dd43a48979db84b48835b3e07", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Tenant: admin May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Tenant-Id: 67ffb05dd43a48979db84b48835b3e07 May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Tenant-Name: admin May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User: admin May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User-Domain-Id: default May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User-Domain-Name: Default May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User-Id: 87e06b5266a1425fb48c02407f951f73 May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User-Name: admin May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: method: > May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: exception: Flavor 84 could not be found. May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: action_args: {'id': '84'} May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:16:50.422993 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:16:50.423853 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:50.425258 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-62148b07-4226-4799-bf1e-22e3b78a819b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:16:50.426503 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-62148b07-4226-4799-bf1e-22e3b78a819b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012084 May 19 12:16:50.426503 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Thu May 19 12:16:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 19 12:16:51.322759 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-820e25bf-a738-4653-8c5d-6f1369c1fae7 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:51.323797 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-820e25bf-a738-4653-8c5d-6f1369c1fae7 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 19 12:16:51.324192 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Thu May 19 12:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:51.515300 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-a5a2f279-ea1e-4776-9d6a-5fc9b69393f4 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:51.523085 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.wsgi [None req-a5a2f279-ea1e-4776-9d6a-5fc9b69393f4 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-a5a2f279-ea1e-4776-9d6a-5fc9b69393f4 admin admin] Request method failure captured: May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Accept: application/json May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Accept-Encoding: gzip, deflate May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Connection: keep-alive May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Content-Length: 0 May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Host: 10.222.0.57 May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Openstack-Api-Version: compute 2.90 May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Openstack-System-Scope: None May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: User-Agent: python-novaclient May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Auth-Token: gAAAAABihjUztvhphQtH72cfXnf2KJfbEuud7O9aOj4Ur6OAhCZn1jxk2-_HRkzrH6KJMCj2ZHyq_lpV6zUib4fcSp7PgGfdUOLBxnT2FVYfYqE34JvA2EpvSapKEZGYHSt29CFGTw0HMvvickWfkh6sybzF7qRgz0tUP1MRKCRiog_SRNCQM_s May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Domain-Id: None May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Domain-Name: None May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Identity-Status: Confirmed May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Is-Admin-Project: True May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Openstack-Nova-Api-Version: 2.90 May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Project-Domain-Id: default May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Project-Domain-Name: Default May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Project-Id: 67ffb05dd43a48979db84b48835b3e07 May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Project-Name: admin May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Role: admin,reader,member May 19 12:16:51.524705 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Roles: admin,reader,member May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_67ffb05dd43a48979db84b48835b3e07", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Tenant: admin May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Tenant-Id: 67ffb05dd43a48979db84b48835b3e07 May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-Tenant-Name: admin May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User: admin May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User-Domain-Id: default May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User-Domain-Name: Default May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User-Id: 87e06b5266a1425fb48c02407f951f73 May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: X-User-Name: admin May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: method: > May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: exception: Flavor 451 could not be found. May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: action_args: {'id': '451'} May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:16:51.526108 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:16:51.527002 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: ERROR nova.api.openstack.wsgi May 19 12:16:51.528047 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-a5a2f279-ea1e-4776-9d6a-5fc9b69393f4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:16:51.529051 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-a5a2f279-ea1e-4776-9d6a-5fc9b69393f4 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062860 May 19 12:16:51.529051 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Thu May 19 12:16:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 19 12:16:51.540721 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-fba709cd-6b94-435e-962f-c7bb91a72405 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:51.554747 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-fba709cd-6b94-435e-962f-c7bb91a72405 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017537 May 19 12:16:51.555317 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Thu May 19 12:16:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:16:51.565517 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:51.580356 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019021 May 19 12:16:51.580890 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Thu May 19 12:16:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:16:51.590333 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-0918868a-12dd-43fd-8bad-bb9b26971473 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:51.596985 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.wsgi [None req-0918868a-12dd-43fd-8bad-bb9b26971473 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-0918868a-12dd-43fd-8bad-bb9b26971473 admin admin] Request method failure captured: May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Accept: application/json May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Accept-Encoding: gzip, deflate May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Connection: keep-alive May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Content-Length: 0 May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Host: 10.222.0.57 May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Openstack-Api-Version: compute 2.90 May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Openstack-System-Scope: None May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: User-Agent: python-novaclient May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Auth-Token: gAAAAABihjUztvhphQtH72cfXnf2KJfbEuud7O9aOj4Ur6OAhCZn1jxk2-_HRkzrH6KJMCj2ZHyq_lpV6zUib4fcSp7PgGfdUOLBxnT2FVYfYqE34JvA2EpvSapKEZGYHSt29CFGTw0HMvvickWfkh6sybzF7qRgz0tUP1MRKCRiog_SRNCQM_s May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Domain-Id: None May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Domain-Name: None May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Identity-Status: Confirmed May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Is-Admin-Project: True May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Openstack-Nova-Api-Version: 2.90 May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Project-Domain-Id: default May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Project-Domain-Name: Default May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Project-Id: 67ffb05dd43a48979db84b48835b3e07 May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Project-Name: admin May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Role: admin,reader,member May 19 12:16:51.598513 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Roles: admin,reader,member May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/67ffb05dd43a48979db84b48835b3e07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_67ffb05dd43a48979db84b48835b3e07", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Tenant: admin May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Tenant-Id: 67ffb05dd43a48979db84b48835b3e07 May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-Tenant-Name: admin May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User: admin May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User-Domain-Id: default May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User-Domain-Name: Default May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User-Id: 87e06b5266a1425fb48c02407f951f73 May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: X-User-Name: admin May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: method: > May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: exception: Flavor 451 could not be found. May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: action_args: {'id': '451'} May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:16:51.599948 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:16:51.600890 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: ERROR nova.api.openstack.wsgi May 19 12:16:51.602249 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-0918868a-12dd-43fd-8bad-bb9b26971473 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:16:51.603495 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-0918868a-12dd-43fd-8bad-bb9b26971473 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013273 May 19 12:16:51.603495 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Thu May 19 12:16:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 12:16:52.505348 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:52.506364 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 May 19 12:16:52.506873 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Thu May 19 12:16:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:52.696579 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-c79bff01-b080-4438-a498-87bd3900d104 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:52.807273 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-c79bff01-b080-4438-a498-87bd3900d104 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.162444 May 19 12:16:52.807741 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Thu May 19 12:16:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:16:53.707448 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:53.708582 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 19 12:16:53.708960 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Thu May 19 12:16:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:53.918363 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-8ab9474f-11b0-42c8-98e5-bc46c1bdca3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:53.990901 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-8ab9474f-11b0-42c8-98e5-bc46c1bdca3e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.127900 May 19 12:16:53.991445 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Thu May 19 12:16:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:16:54.885336 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:54.886344 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 19 12:16:54.886772 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Thu May 19 12:16:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:55.076431 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-0faa0f6e-da7b-4341-a5d3-6f01b23b5cdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:55.372499 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-0faa0f6e-da7b-4341-a5d3-6f01b23b5cdc admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.347528 May 19 12:16:55.373072 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Thu May 19 12:16:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:16:56.261198 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:56.262279 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 19 12:16:56.262718 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Thu May 19 12:16:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:56.457532 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-2c8524ab-8dba-4d9f-a9cf-b24f7cd0d8c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:16:56.533183 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-2c8524ab-8dba-4d9f-a9cf-b24f7cd0d8c3 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.128950 May 19 12:16:56.533733 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Thu May 19 12:16:56 2022] POST /compute/v2.1/flavors => generated 409 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:16:57.585601 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:57.586644 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 19 12:16:57.587081 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Thu May 19 12:16:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:16:57.816928 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-e239e3bd-2f42-4374-86fb-a890aa9ce125 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:16:57.838296 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-e239e3bd-2f42-4374-86fb-a890aa9ce125 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074868 May 19 12:16:57.838870 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Thu May 19 12:16:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:18:01.648799 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:01.649807 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-1b8b3b59-af63-4024-9d0a-4da02d6ed109 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 19 12:18:01.650203 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 930 bytes} [Thu May 19 12:18:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:18:01.657689 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:01.710842 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-5441a91b-e63e-48ab-a85f-bac46099645c admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:01.730441 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-5441a91b-e63e-48ab-a85f-bac46099645c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074106 May 19 12:18:01.730984 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1291 bytes} [Thu May 19 12:18:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:18:01.751013 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG dbcounter [-] [103657] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103657) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:18:01.754722 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-74bb3eea-e3f7-41ec-8470-bf3288f99619 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:01.762161 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-74bb3eea-e3f7-41ec-8470-bf3288f99619 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012588 May 19 12:18:01.762724 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1282 bytes} [Thu May 19 12:18:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:01.774973 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-f7304019-ee01-4556-92b8-23b59eccb409 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:01.783575 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-f7304019-ee01-4556-92b8-23b59eccb409 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012439 May 19 12:18:01.784035 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1285 bytes} [Thu May 19 12:18:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:01.796501 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-a88fc2af-8e48-467a-86e6-3532d86c1a29 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:01.804292 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-a88fc2af-8e48-467a-86e6-3532d86c1a29 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012649 May 19 12:18:01.804815 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1285 bytes} [Thu May 19 12:18:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:18:01.816556 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-cf5e1308-b501-4fd3-a4e8-8107eacc704b admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:18:01.824217 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-cf5e1308-b501-4fd3-a4e8-8107eacc704b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011310 May 19 12:18:01.824708 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1282 bytes} [Thu May 19 12:18:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:22:01.453137 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-a88fc2af-8e48-467a-86e6-3532d86c1a29 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:01.455234 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-a88fc2af-8e48-467a-86e6-3532d86c1a29 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002528 May 19 12:22:01.455725 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Thu May 19 12:22:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:01.628421 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writing DB stats nova_api:SELECT=6 {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:01.768801 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-255612a6-2db5-417b-be1c-50a3b8551e2d admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:01.769958 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:22:01.769958 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: warnings.warn(msg) May 19 12:22:01.771255 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-255612a6-2db5-417b-be1c-50a3b8551e2d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:01.771694 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-255612a6-2db5-417b-be1c-50a3b8551e2d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:01.772539 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-255612a6-2db5-417b-be1c-50a3b8551e2d admin admin] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:01.772963 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-255612a6-2db5-417b-be1c-50a3b8551e2d admin admin] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:01.820145 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-255612a6-2db5-417b-be1c-50a3b8551e2d admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.193375 May 19 12:22:01.820756 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Thu May 19 12:22:01 2022] GET /compute/v2.1/os-services => generated 794 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:22:02.932663 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-a88fc2af-8e48-467a-86e6-3532d86c1a29 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:02.933783 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-a88fc2af-8e48-467a-86e6-3532d86c1a29 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001943 May 19 12:22:02.934502 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Thu May 19 12:22:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:03.192655 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-810007db-044f-456d-b5db-cdc1d7889348 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:03.194966 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:22:03.194966 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: warnings.warn(msg) May 19 12:22:03.197415 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-810007db-044f-456d-b5db-cdc1d7889348 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:03.199523 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-810007db-044f-456d-b5db-cdc1d7889348 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:03.199719 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-810007db-044f-456d-b5db-cdc1d7889348 admin admin] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:03.200376 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-810007db-044f-456d-b5db-cdc1d7889348 admin admin] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:03.243568 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-810007db-044f-456d-b5db-cdc1d7889348 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.144239 May 19 12:22:03.244723 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Thu May 19 12:22:03 2022] GET /compute/v2.1/os-services => generated 794 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:22:14.775813 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-a88fc2af-8e48-467a-86e6-3532d86c1a29 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:14.776988 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-a88fc2af-8e48-467a-86e6-3532d86c1a29 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 May 19 12:22:14.777464 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Thu May 19 12:22:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:14.954753 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writing DB stats nova_cell0:SELECT=4 {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:14.955622 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writing DB stats nova_cell1:SELECT=4 {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:14.956429 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG dbcounter [-] [103658] Writing DB stats nova_api:SELECT=8 {{(pid=103658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:22:15.014344 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-4aed3743-5c00-4d68-b97b-76e98ff8c36a admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:15.015602 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:22:15.015602 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: warnings.warn(msg) May 19 12:22:15.017575 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-4aed3743-5c00-4d68-b97b-76e98ff8c36a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:15.018043 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-4aed3743-5c00-4d68-b97b-76e98ff8c36a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:15.018975 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-4aed3743-5c00-4d68-b97b-76e98ff8c36a admin admin] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:15.019499 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-4aed3743-5c00-4d68-b97b-76e98ff8c36a admin admin] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:15.061697 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-4aed3743-5c00-4d68-b97b-76e98ff8c36a admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.112061 May 19 12:22:15.062865 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Thu May 19 12:22:14 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:22:16.056203 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: DEBUG nova.api.openstack.wsgi [None req-a88fc2af-8e48-467a-86e6-3532d86c1a29 admin admin] Calling method '>' {{(pid=103657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:16.064421 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: INFO nova.api.openstack.requestlog [None req-a88fc2af-8e48-467a-86e6-3532d86c1a29 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001846 May 19 12:22:16.064421 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: [pid: 103657|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Thu May 19 12:22:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:22:16.296303 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG nova.api.openstack.wsgi [None req-69235739-42b8-4921-9977-20899d3184c2 admin admin] Calling method '>' {{(pid=103658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:22:16.297774 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 12:22:16.297774 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: warnings.warn(msg) May 19 12:22:16.299455 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-69235739-42b8-4921-9977-20899d3184c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:16.299958 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-69235739-42b8-4921-9977-20899d3184c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:16.301063 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-69235739-42b8-4921-9977-20899d3184c2 admin admin] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:22:16.301668 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: DEBUG oslo_concurrency.lockutils [None req-69235739-42b8-4921-9977-20899d3184c2 admin admin] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:22:16.340934 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: INFO nova.api.openstack.requestlog [None req-69235739-42b8-4921-9977-20899d3184c2 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.139710 May 19 12:22:16.341977 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: [pid: 103658|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Thu May 19 12:22:16 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:23:16.645433 dv-cinder-778193-27-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 19 12:23:16.646176 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: Thu May 19 12:23:16 2022 - graceful shutdown triggered... May 19 12:23:16.646689 dv-cinder-778193-27-iscsi devstack@n-api.service[103657]: Gracefully killing worker 1 (pid: 103657)... May 19 12:23:16.647639 dv-cinder-778193-27-iscsi devstack@n-api.service[103658]: Gracefully killing worker 2 (pid: 103658)... May 19 12:23:17.647143 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: worker 1 buried after 1 seconds May 19 12:23:17.647143 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: worker 2 buried after 1 seconds May 19 12:23:17.647143 dv-cinder-778193-27-iscsi devstack@n-api.service[103656]: goodbye to uWSGI. May 19 12:23:17.648696 dv-cinder-778193-27-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 19 12:23:17.649315 dv-cinder-778193-27-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 19 12:23:17.652067 dv-cinder-778193-27-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 12:23:17.667014 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 12:23:17.682791 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 12:23:17 2022] *** May 19 12:23:17.682791 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 12:23:17.682791 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 12:23:17.682791 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: nodename: dv-cinder-778193-27-iscsi May 19 12:23:17.682791 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: machine: x86_64 May 19 12:23:17.682791 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: clock source: unix May 19 12:23:17.682791 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: pcre jit disabled May 19 12:23:17.682791 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: detected number of CPU cores: 4 May 19 12:23:17.682791 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: current working directory: / May 19 12:23:17.682791 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: detected binary path: /usr/bin/uwsgi-core May 19 12:23:17.683797 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: your processes number limit is 47680 May 19 12:23:17.683797 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: your memory page size is 4096 bytes May 19 12:23:17.683797 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: detected max file descriptor number: 2048 May 19 12:23:17.683797 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: lock engine: pthread robust mutexes May 19 12:23:17.683797 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: thunder lock: enabled May 19 12:23:17.683797 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 12:23:17.683797 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 12:23:17.732102 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: Python main interpreter initialized at 0x555f6d4de9c0 May 19 12:23:17.732102 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: python threads support enabled May 19 12:23:17.732102 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: your server socket listen backlog is limited to 100 connections May 19 12:23:17.732102 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: your mercy for graceful operations on workers is 90 seconds May 19 12:23:17.732565 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: mapped 403077 bytes (393 KB) for 2 cores May 19 12:23:17.732565 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: *** Operational MODE: preforking *** May 19 12:23:17.732839 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: *** uWSGI is running in multiple interpreter mode *** May 19 12:23:17.732839 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: spawned uWSGI master process (pid: 118095) May 19 12:23:17.733048 dv-cinder-778193-27-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 12:23:17.733625 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: spawned uWSGI worker 1 (pid: 118111, cores: 1) May 19 12:23:17.734178 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: spawned uWSGI worker 2 (pid: 118112, cores: 1) May 19 12:23:17.734527 dv-cinder-778193-27-iscsi devstack@n-api.service[118095]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 12:23:19.021845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 12:23:19.050459 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 12:23:19.865859 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:23:19.865859 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: from cryptography.utils import int_from_bytes May 19 12:23:19.866251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:23:19.866251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: from cryptography.utils import int_from_bytes May 19 12:23:19.937115 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:23:19.937115 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: from cryptography.utils import int_from_bytes May 19 12:23:19.937423 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 12:23:19.937423 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: from cryptography.utils import int_from_bytes May 19 12:23:22.461740 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 12:23:22.462299 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 12:23:22.462562 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 12:23:22.462935 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 12:23:22.463192 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 12:23:22.463583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.463912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.464233 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.464558 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.464890 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.465203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.465529 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.465851 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.466182 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.466482 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.466805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.467131 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-778193-27-iscsi {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.467543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.467861 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.468178 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.468499 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.468806 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.469131 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.469439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.469945 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.471059 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.471962 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.471962 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.472463 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.472463 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.472761 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.472957 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.473271 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.473600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.473914 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.474329 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-778193-27-iscsi {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.474721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.475278 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.475450 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.481267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.481267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.481267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.481267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.481267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.481267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.481267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.481267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.490169 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.490169 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.490169 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.490169 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.490169 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.490169 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.490169 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.490169 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.491693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.493382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.493382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.493382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.493382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.493382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.493382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.493382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.493382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.494971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.495586 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.495586 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.495586 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.495586 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.495586 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.495586 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.495586 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.495586 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.496236 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.496236 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.496400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.496693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.496996 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.497304 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.497639 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.497973 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.498284 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.498624 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.498932 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.499242 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.499564 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.499873 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.500184 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.500524 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.500985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.501283 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.501652 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.501966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.502274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.502658 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.502943 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.503255 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.503577 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.503894 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.504204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.504510 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.504822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.505123 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.505428 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.505803 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.506044 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.506346 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.506772 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.507155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.507472 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.507782 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.508092 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.508416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.508909 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.509259 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.509606 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.509922 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.510297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.510625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.510950 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.511264 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.511587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.511921 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.512238 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.512554 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.512870 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.513194 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.513527 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.513866 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.514188 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.514630 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.514992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.515424 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.515753 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.515967 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.516335 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.516654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.517000 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.517375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.517699 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.518027 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.518912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.518912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.519119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.519302 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.519632 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.519993 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.521152 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.521152 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.521152 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.521401 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.521585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.521902 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.522237 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.522598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.522918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.523247 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.523566 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.523885 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.524200 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.524757 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.524992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.525178 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.525504 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.525814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.526131 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.526131 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.526131 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.526131 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.526131 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.526131 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.526131 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.526131 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.533868 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.533868 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.533868 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.533868 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.533868 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.533868 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.533868 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.533868 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.535799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.535799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.535799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.535799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.535799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.535799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.535799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.535799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.536290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.536290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.536290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.536290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.536290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.536290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.536290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.536864 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.536864 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.537094 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.537419 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.537718 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.538028 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.538341 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.538683 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.538999 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.539310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.539621 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.539934 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.540251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.540579 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.540886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.541198 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.541513 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.541821 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.542132 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.542507 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.542821 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.543178 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.543632 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.543910 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.544239 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.544555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.544875 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.545191 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.545510 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.545845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.546144 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.546752 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.547072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.547400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.547719 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.548136 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.548432 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.549246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.549557 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.549881 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.550224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.550590 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.550913 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.551243 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.551559 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.551883 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.552199 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.552514 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.553571 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.553571 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.553571 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.553845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.554065 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.554376 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.554730 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.555086 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.555406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.555714 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.556030 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.556363 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.556703 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.557043 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.558721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.558721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.558721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.558721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.558721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.559223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.559223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.559511 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.559829 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.560180 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.560495 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.560761 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.561078 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.561396 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.561701 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.562071 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.562467 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.562997 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.563307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.563638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.564003 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.564377 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.564616 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.564989 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.565244 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.565551 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.565861 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.566170 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.566657 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.573918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.573918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.573918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.573918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.573918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.573918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.573918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.573918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.574708 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.574708 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.574708 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.574708 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.574708 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.574708 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.574708 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.574708 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.575680 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.575680 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.575680 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.575680 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.575680 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.575680 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.575680 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.575680 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.576756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.576756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.576756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.576756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.576756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.576756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.576756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.576756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.577751 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.577751 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.577751 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.578345 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.578345 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.578991 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.578991 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.579317 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.579317 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.579722 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.579996 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.580390 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.580720 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.581253 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.581445 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.581638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.581920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.582240 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.582576 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.582869 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.583177 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.583530 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.583837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.584179 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.584700 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.585049 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.585389 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.585656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.585988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.586299 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.586638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.586979 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.587293 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.587604 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.587909 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.588256 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.588526 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.588886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.589210 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.589433 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.589741 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.590240 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.590589 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.590925 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.591415 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.591631 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.591915 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.592246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.592646 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.592855 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.593161 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.593463 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.593766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.594077 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.594383 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.594708 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.595104 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.596111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.596467 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.596780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.597091 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.597400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.597717 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.598025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.598371 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.598672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.599005 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.599327 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.599635 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.599951 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.600261 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.601170 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.601170 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.601170 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.601730 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.601730 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.602045 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.602355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.602814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.603125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.603437 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.603745 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.604053 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.604360 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.604713 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.605021 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.605385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.605695 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.606014 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.606489 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.606723 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.607594 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.607594 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.607902 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.608063 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.608262 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.608593 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.608874 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.609183 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.609513 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.609829 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.610145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.610495 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.610875 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.611858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.612190 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.612403 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.612959 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.613508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.614069 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.614575 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.614905 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.619842 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.619842 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.619842 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.619842 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.619842 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.619842 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.619842 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.619842 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.621084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.621084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.621084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.621084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.621084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.621084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.621084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.621084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.622498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.622498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.622498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.622498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.622498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.622498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.622498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.623738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.623738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.623738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.623738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.624263 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.624263 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.624603 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.624777 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.625108 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.625420 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.625730 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.626037 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.626364 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.626721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.627049 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.627498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.627796 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.628109 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.628531 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.628888 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.629147 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.629513 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.629843 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.630173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.630509 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.630883 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.631718 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.631718 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.632045 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.632278 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 12:23:22.632971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.633154 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 12:23:22.633398 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.633398 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.633693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 12:23:22.633834 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.633998 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 12:23:22.634140 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.634295 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 12:23:22.634511 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.634659 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.634800 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.635000 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.635151 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.635302 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.635451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.635592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.635741 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.635938 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.636095 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.636255 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.636408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.636549 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.636690 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.636838 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.636994 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.637136 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.637276 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.637431 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.637578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.637727 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.637891 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.638041 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-778193-27-iscsi {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.638190 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.638331 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.638585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.638732 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.639083 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.639241 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.639401 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.639628 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.639798 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.640050 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.640215 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.640367 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.640516 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.640657 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.640804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.640959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.641120 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.641350 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.641513 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.641663 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.641803 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.641959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.642151 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.642381 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.642676 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.642832 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.643194 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.643353 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.643595 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.643742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.643891 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.644042 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.644193 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.644334 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.644492 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.644641 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.644791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.644791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.645082 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-778193-27-iscsi {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.645224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.645364 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.645510 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.645651 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.645651 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.645930 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.645930 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.646204 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.646356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.646547 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.646690 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.646832 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.646986 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.647172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.647332 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.647487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.647629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.647768 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.647915 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.648093 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.648237 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.648401 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.648543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.648682 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.648830 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.648999 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.649344 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.649490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.649649 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.649884 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.650047 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.650283 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.650480 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.650672 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.650816 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.650964 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.651106 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.651253 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.651513 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.651670 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.651811 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.651959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.652099 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.652248 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.652848 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.653019 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.653637 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.653895 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.654057 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.654287 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.654287 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.654633 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.654775 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.654923 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.655071 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.655297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.655452 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.655613 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.655613 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.655881 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.655881 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.656190 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.656366 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.656511 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.656660 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.656801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.660743 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.660947 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.661103 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.661258 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.661382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.661799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.661939 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.662060 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.662180 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.662290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.662290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.669713 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.669890 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.670065 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.670228 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.670760 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.670911 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.671153 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.671331 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.671883 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.672045 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.672258 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.672442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.672610 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.672779 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.673073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.673073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.674383 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.674594 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.674746 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.674885 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.675015 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.675143 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.675271 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.675407 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.675551 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.675682 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.675817 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.675953 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.676114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.676303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.676444 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.676583 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.676711 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.676839 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.677004 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.677180 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.677319 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.677456 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.677586 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.677723 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.677860 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.677999 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.678128 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.678264 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.678392 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.678747 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.678923 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.679090 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.679256 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.679414 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.679595 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.679764 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.679936 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.680094 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.680252 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.680889 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.681073 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.681261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.681429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.681587 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.681743 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.682023 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.682190 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.682358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.682576 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.682747 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.682905 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.683189 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.683363 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.683536 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.683703 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.683861 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.684031 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.684658 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.684829 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.684999 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.685157 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.685340 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.685508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.685665 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.685834 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.686001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.686163 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.686310 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.686486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.686662 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.686822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.686822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.687092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.687235 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.687365 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.687492 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.687619 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.687755 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.687891 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.688032 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.688168 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.688296 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.688431 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.688567 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.688567 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.688858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.689177 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.689177 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.689499 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.689665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.689991 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.690239 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.690429 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.691111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.691111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.691429 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.691598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.691598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.691906 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.692190 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.692350 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.692507 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.692507 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.692832 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.692989 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.693251 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.693455 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.693613 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.693823 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.693823 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.694131 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.694474 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.695020 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.695192 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.695366 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.695535 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.695535 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.695836 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.696003 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.696003 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.696319 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.696478 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.696643 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.696809 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.696977 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.697146 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.697146 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.697435 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 12:23:22.697575 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.697710 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.697876 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.697876 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.698139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.698268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.698396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.698635 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.698635 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.698895 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.699034 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.699171 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.699309 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.699309 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.699559 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.699697 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.699824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.699960 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.699960 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.700210 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.700355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.700485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.700621 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.700621 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.701258 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.701438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.701438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.701772 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.701909 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.701909 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.702182 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.702398 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.702398 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.702709 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.702836 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.702998 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.703140 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.703140 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.703493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.703624 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.703624 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.703624 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.704002 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.704143 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.704272 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.704414 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.704656 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.705160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.705160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.705425 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.705555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.705682 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.705809 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.705945 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.706087 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.706215 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.706578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.706707 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.706834 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.706834 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.707106 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.707245 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.707380 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.707509 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.707509 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.707766 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.707903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.708040 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.708175 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.708303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.708438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.708438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.708765 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.708894 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.709031 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.709166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.709166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.709426 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.709632 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.709763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.709899 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.709899 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.710156 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.710293 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.710293 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.710576 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.710732 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.710732 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.711180 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.711474 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.711606 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.711762 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.711762 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.712014 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.712185 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.712185 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.712525 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.712656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.712656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.712930 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.713066 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.713239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.713376 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.713525 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.713733 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.713733 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.713990 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.714120 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.714287 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.714440 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.714440 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.714783 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.721671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.721856 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.722035 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.722035 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.722332 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.722545 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.722545 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.722955 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.723100 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.723242 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.723392 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.723550 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.723711 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.723711 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.724089 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.724232 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.724232 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.724523 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.724673 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.724931 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.725086 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.725086 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.725630 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.725793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.725939 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.726090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.726090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.726381 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.726569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.726569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.726874 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.727022 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.727022 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.727292 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.727443 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.727443 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.727712 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.727852 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.727994 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.728143 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.728143 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.728433 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.728581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.728728 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.728919 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.728919 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.729211 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.729387 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.729581 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.729728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.729728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.730006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.730148 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.730148 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.730459 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.730619 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.730763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.730946 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.730946 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.731487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.731804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.731804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.732084 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.732236 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.732386 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.732539 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.732680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.732680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.732680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.732680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.732680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.732680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.733702 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.733853 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.734110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.734261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.734470 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.734624 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.734778 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.735049 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.735215 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.735361 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.735519 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.736426 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.736583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.736727 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.736883 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.737187 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.737343 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.737521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.737669 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.737834 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.737994 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.738138 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.738294 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.738458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.738617 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.738791 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.739057 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.739214 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.739356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.739498 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.739653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.739815 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.739959 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.740107 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.740250 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.740401 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.740588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.740755 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.740918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.741141 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.741299 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.741676 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.742010 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.742157 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.742318 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.742508 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.742678 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.742836 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.743093 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.743242 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.743242 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.743527 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.743680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.743835 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.743986 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.744236 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.744398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.744548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.744707 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.744850 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.744991 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.745250 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.745250 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.745564 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.745723 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.746101 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.746251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.746420 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.746420 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.746713 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.746869 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.747012 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.747196 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.747350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.747493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.747644 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.747794 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.747944 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.748092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.748234 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.748384 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.748539 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.748704 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.748859 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.749003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.749180 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.749339 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.749492 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.749643 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.749821 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.750001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.750145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.750287 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.750490 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 12:23:22.750653 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.750653 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.750653 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.750653 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.750653 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.750653 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.750653 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.750653 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.752375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.752375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.752375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.752375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.752375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.752375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.752375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.752375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.753682 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.753682 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.753682 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.753682 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.753682 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.753682 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.753682 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.753682 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.754922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.754922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.754922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.754922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.754922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.754922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.754922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.754922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.756422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.756422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.756422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.756422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.756422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.756422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.756422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.756422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.757561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.757561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.757561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.757561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.757561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.757561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.757561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.757561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.759376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.759376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.759376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.759376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.759376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.759376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.759376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.759376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.760501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.760501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.760501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.760501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.760501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.760501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.760501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.760501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.761639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.761639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.761639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.761639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.761639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.761639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.761639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.761639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.763465 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.763465 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.763465 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.763465 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.763465 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.763465 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.763465 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.763465 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.764668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.764668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.764668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.764668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.764668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.764668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.764668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.764668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.765909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.765909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.765909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.765909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.765909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.765909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.765909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.765909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.767398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.767398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.767398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.767398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.767398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.767398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.767398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.768363 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.768363 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.768648 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.768876 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.769111 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.769453 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.769807 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.770639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.770639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.770946 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.771414 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.771414 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.771809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.771997 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.772502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.772652 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.772970 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.773290 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.773612 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.774384 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.774384 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.774851 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.774851 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.775153 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.775462 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.775772 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.776083 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.776399 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.776909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.777069 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.777373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.777686 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.778014 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.778325 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.778662 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.778973 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.779287 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.779596 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.779905 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.780239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.780575 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.780882 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.781208 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.781560 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.781824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.782131 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.782548 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.783335 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.783859 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.784179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.784709 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.784892 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.785127 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.786492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.786492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.786492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.786492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.787376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.787376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.787376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.788065 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.788065 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.788235 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.788480 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.788737 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.789070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.789388 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.789742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.790058 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.790466 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.790807 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.791131 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.791469 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.791826 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.792091 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.792474 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.792795 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.793116 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.793430 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.793742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.794072 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.794392 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.794732 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.794933 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO dbcounter [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] Registered counter for database nova_api May 19 12:23:22.795086 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.795378 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.795713 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.796028 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.796349 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.796935 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.797252 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.797572 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.797889 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.798210 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.799284 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.799614 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.800030 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.800357 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.800676 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.800995 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.801315 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.801630 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.801969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.802289 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.802632 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.802951 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.803263 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.803594 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.803907 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.804357 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.804685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.804999 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.805311 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.805629 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.805946 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.806445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.806661 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.806930 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.807361 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.807684 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.810566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.810566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.810566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.810566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.810566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.810566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.810566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.810566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.812006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.812006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.812006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.812006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.812006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.813220 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.813220 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.813220 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.813719 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.814225 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.815030 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.815323 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.815524 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.815700 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.816028 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.816350 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.816687 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.817032 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.817344 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.817681 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.818052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.818395 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.818757 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.818975 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_db.sqlalchemy.engines [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:23:22.819183 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.819541 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.819986 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.820374 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.820736 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.821070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.821507 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.821828 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.822198 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.822621 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.822964 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.823350 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.823758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.824112 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.824802 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.825134 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.825461 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.825777 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.826088 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.826445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.826767 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.827093 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.827421 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.827554 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writer thread running {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:23:22.827924 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.828139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.828456 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.828796 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.829158 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.829474 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.830721 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.831283 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.831438 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.831729 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.832064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.832413 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.832802 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.833127 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.833475 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.833810 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.834144 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.834502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.834834 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.835152 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.835466 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.835786 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.836099 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.836418 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.836728 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.837045 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.837372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.837666 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.838008 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.838375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.838713 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.839048 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.839369 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.839680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.839994 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.840307 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.840662 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.840975 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.841318 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.841648 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.842036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.842375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.842723 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.843062 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.843388 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.843717 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.844074 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.844526 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.844855 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.845238 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.846096 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.846451 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.846766 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.847091 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.847422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.848004 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.848346 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.848668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.848991 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.849312 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.849703 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.850021 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.850425 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.850694 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.851017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.851341 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.851678 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.852012 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.852349 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.852703 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.853033 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.853822 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.854150 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.854499 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.854877 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.855200 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.855516 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.855840 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.856165 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.856490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.856809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.857130 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.857447 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.857766 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.858092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.858436 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.858744 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.859067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.859401 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.859747 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.860073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.860395 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.860716 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.861507 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.862096 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.862437 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.862875 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.863221 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.863529 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.864032 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.864277 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.864526 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.864854 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.865165 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.865484 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.865801 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.866118 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.866478 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.866805 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.867115 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.867440 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.867758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.868336 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.868707 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.869038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.869370 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.869708 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.870034 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.870355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.870754 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.871121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.871441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.871766 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.872104 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.872400 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.872771 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.873041 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.873365 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.873680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.873999 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.874315 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.874683 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.875087 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.875372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.875689 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.876008 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.876326 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.876679 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.876997 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.877303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.877856 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.878176 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.878530 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.878852 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.879176 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.879550 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.879874 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.880253 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.880598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.880967 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.881230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.881564 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.881887 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.882216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.882563 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.882885 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.883251 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.883580 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.884172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.884517 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.884844 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.885195 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.885536 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.885853 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.886071 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.context [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),265c6b0e-6307-4ee8-8365-0ad79f4145cf(cell1) {{(pid=118112) load_cells /opt/stack/nova/nova/context.py:464}} May 19 12:23:22.886235 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.886495 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.886829 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.887149 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.887470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.887788 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.888107 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.888427 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.888751 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.889064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.889384 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.889700 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.890045 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.890359 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.890703 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.890872 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:22.891013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.891366 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.891694 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.892828 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.892994 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:22.893180 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.893528 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.893685 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:22.893877 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.894192 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.894547 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.894873 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.895239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.895590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.895866 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:22.896128 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.896282 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.897297 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.897297 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.897607 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.899018 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.899183 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO dbcounter [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] Registered counter for database nova_cell0 May 19 12:23:22.899358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.899358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.899358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.899358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.899358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.900189 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.900189 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.900352 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.900594 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.900935 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.901287 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.901600 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.901916 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.902243 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.902352 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO dbcounter [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] Registered counter for database nova_cell1 May 19 12:23:22.902594 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.902919 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.903232 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.903547 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.903860 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.904173 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.906239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.906239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.906239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.906239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.906239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.906239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.906884 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.906884 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.907214 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.907524 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.908398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.908715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.909059 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.909377 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.909699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.910009 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.910369 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.910744 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.911071 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.911405 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.911730 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.912069 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.912420 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.912939 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.913213 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_db.sqlalchemy.engines [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:23:22.913401 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.913590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.913915 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.914263 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.914668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.914998 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.915373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.915697 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.916019 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.916396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.916634 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_db.sqlalchemy.engines [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:23:22.916735 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.917061 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.917376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.917718 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.918042 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.918479 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.918770 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.919094 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.919432 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.919914 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.920113 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.920513 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.920829 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.921155 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.921746 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.922074 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.922520 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.922655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writer thread running {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:23:22.922774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.923073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.923452 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.923794 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.924153 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.924475 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.924661 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writer thread running {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:23:22.924832 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.925179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.925502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.925826 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.926141 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 12:23:22.926392 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 12:23:22.988212 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO dbcounter [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] Registered counter for database nova_api May 19 12:23:23.009784 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:23:23.018164 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writer thread running {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:23:23.076404 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO dbcounter [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] Registered counter for database nova_cell0 May 19 12:23:23.076629 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.context [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),265c6b0e-6307-4ee8-8365-0ad79f4145cf(cell1) {{(pid=118111) load_cells /opt/stack/nova/nova/context.py:464}} May 19 12:23:23.081834 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:23.083593 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:23.084117 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_db.sqlalchemy.engines [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:23:23.084474 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:23:23.086536 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:23:23.088595 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO dbcounter [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] Registered counter for database nova_cell0 May 19 12:23:23.088826 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writer thread running {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:23:23.092957 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO dbcounter [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] Registered counter for database nova_cell1 May 19 12:23:23.101475 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:23:23.102967 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:23:23.109184 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writer thread running {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:23:23.114813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writer thread running {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:23:23.264508 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO dbcounter [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] Registered counter for database nova_cell0 May 19 12:23:23.272534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_db.sqlalchemy.engines [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 12:23:23.279562 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writer thread running {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 12:23:23.422886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: WARNING keystonemiddleware.auth_token [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:23:23.430686 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: WARNING keystonemiddleware.auth_token [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:23:23.631467 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: WARNING keystonemiddleware.auth_token [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:23:23.639121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: WARNING keystonemiddleware.auth_token [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:23:23.784377 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: WARNING keystonemiddleware.auth_token [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:23:23.790651 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: WARNING keystonemiddleware.auth_token [None req-c7e08bac-d770-4781-bccd-79329a579729 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:23:23.796163 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555f6d4de9c0 pid: 118112 (default app) May 19 12:23:24.009091 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: WARNING keystonemiddleware.auth_token [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 12:23:24.015384 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: WARNING keystonemiddleware.auth_token [None req-4f4be8cd-951b-4380-8872-8bb368439574 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 12:23:24.022011 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x555f6d4de9c0 pid: 118111 (default app) May 19 12:24:14.492956 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=3 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:14.496149 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=3 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:14.497347 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=3 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:14.498688 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=3 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:15.200702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3a2a37cb-e650-4844-948f-61935d2f7dd3 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] Calling method '.version_select at 0x7fd45777cf70>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:15.292178 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:15.293699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:15.295052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:15.295943 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:15.477202 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2073900902", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "networks": [{"uuid": "2f3390c0-b684-4d42-a2cd-9e9a66f58fcb"}]}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:15.859323 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3a2a37cb-e650-4844-948f-61935d2f7dd3 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/2829dc5d-74ac-4999-b980-dbb326f906c1" status: 200 len: 350 microversion: 2.1 time: 1.246678 May 19 12:24:15.863358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 1/1] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:24:14 2022] GET /compute/v2.1/os-volumes/2829dc5d-74ac-4999-b980-dbb326f906c1 => generated 350 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:16.514771 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.network.neutron [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] validate_networks() for [('2f3390c0-b684-4d42-a2cd-9e9a66f58fcb', None, None, None, None, None)] {{(pid=118112) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:24:17.347346 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2ea20aa7-8277-4c01-b01f-dfe8cb8c5252 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Action: 'create', calling method: .version_select at 0x7fd4575b6550>, body: {"keypair": {"name": "tempest-keypair-58744428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNL0yKlSoMzDeJgXig3MU2IO+23LjtxcVFyZaPHK1VMixZFe9JbG1SRrFJmPe5TRuxCJTyuxTCGez4gpX4s1HivUdMGZe1osEBnGwvX5yPSt39Ha3TpWM3cdQ7m5US13ow=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:17.446565 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-2ea20aa7-8277-4c01-b01f-dfe8cb8c5252 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Getting quotas for project 4f4a6b5e282e45ffbef6963200558594. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:24:17.453299 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-2ea20aa7-8277-4c01-b01f-dfe8cb8c5252 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Getting quotas for user 707a899d6c5d4c4ea1c58e0de6a85b1d and project 4f4a6b5e282e45ffbef6963200558594. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:24:17.615465 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2ea20aa7-8277-4c01-b01f-dfe8cb8c5252 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.602743 May 19 12:24:17.618850 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 2/2] 10.222.0.57 () {60 vars in 1158 bytes} [Thu May 19 12:24:17 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:18.034354 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7dde9cb5-cc13-427b-9507-50fb8780fb52 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] Calling method '.version_select at 0x7fd457529280>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:18.150793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Flavor limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:24:18.152224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Image limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:24:18.152986 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Flavor pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:24:18.153677 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Image pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:24:18.154871 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:24:18.182784 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7dde9cb5-cc13-427b-9507-50fb8780fb52 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/6e177685-cc69-42b9-9b4a-b85c5dff867d" status: 200 len: 350 microversion: 2.1 time: 0.152689 May 19 12:24:18.183412 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 3/3] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:24:18 2022] GET /compute/v2.1/os-volumes/6e177685-cc69-42b9-9b4a-b85c5dff867d => generated 350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:24:18.187507 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:18.189008 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:18.190122 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:18.190752 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:18.275148 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Getting quotas for project 99c98b6b528545f7a18638d5a0f69bb4. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:24:18.285437 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Getting quotas for user 0bcf2df379a44e4bb05c21c495c38483 and project 99c98b6b528545f7a18638d5a0f69bb4. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:24:18.322762 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Going to run 1 instances... {{(pid=118112) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:24:18.326350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:24:18.599657 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4c105717-2695-4163-b283-551e3caf0c02 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.121186 May 19 12:24:18.600944 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 1/4] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:24:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 4124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:24:18.614796 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-488627c7-1f78-4b44-af0d-2b3af391e755 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:18.615787 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-488627c7-1f78-4b44-af0d-2b3af391e755 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:18.789223 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-488627c7-1f78-4b44-af0d-2b3af391e755 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:18.823425 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-488627c7-1f78-4b44-af0d-2b3af391e755 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1215 microversion: 2.1 time: 0.213900 May 19 12:24:18.851147 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 4/5] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:18 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1215 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:19.871843 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-48ba57d8-9639-4031-8489-fffd42bc1e20 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:19.873304 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-48ba57d8-9639-4031-8489-fffd42bc1e20 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:20.246677 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-48ba57d8-9639-4031-8489-fffd42bc1e20 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:20.290397 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-48ba57d8-9639-4031-8489-fffd42bc1e20 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1215 microversion: 2.1 time: 0.425321 May 19 12:24:20.298055 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 2/6] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:19 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1215 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:21.314213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d75e1505-3a1d-440f-a929-2efe2d5be24a tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:21.315466 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d75e1505-3a1d-440f-a929-2efe2d5be24a tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:21.600277 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d75e1505-3a1d-440f-a929-2efe2d5be24a tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:21.608964 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d75e1505-3a1d-440f-a929-2efe2d5be24a tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1215 microversion: 2.1 time: 0.299857 May 19 12:24:21.614644 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 5/7] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:21 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1215 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:22.632404 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-79a63e63-388c-4a4b-9869-705873da0828 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:22.633599 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-79a63e63-388c-4a4b-9869-705873da0828 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:22.641018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-79a63e63-388c-4a4b-9869-705873da0828 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:22.641875 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-79a63e63-388c-4a4b-9869-705873da0828 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:22.643058 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-79a63e63-388c-4a4b-9869-705873da0828 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:22.645447 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-79a63e63-388c-4a4b-9869-705873da0828 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:22.974821 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-79a63e63-388c-4a4b-9869-705873da0828 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:23.007130 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-79a63e63-388c-4a4b-9869-705873da0828 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1219 microversion: 2.1 time: 0.379158 May 19 12:24:23.010008 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 3/8] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:22 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1219 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:24.029945 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1c3f90c3-9311-4b41-acf6-522af6a288c6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:24.030626 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1c3f90c3-9311-4b41-acf6-522af6a288c6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:24.053307 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1c3f90c3-9311-4b41-acf6-522af6a288c6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:24.054353 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1c3f90c3-9311-4b41-acf6-522af6a288c6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:24.055240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1c3f90c3-9311-4b41-acf6-522af6a288c6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:24.062351 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1c3f90c3-9311-4b41-acf6-522af6a288c6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:24.688456 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1c3f90c3-9311-4b41-acf6-522af6a288c6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:24.719697 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1c3f90c3-9311-4b41-acf6-522af6a288c6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1219 microversion: 2.1 time: 0.697161 May 19 12:24:24.720566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 6/9] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:24 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1219 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:25.084389 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f79f45ab-e57a-4dbf-ad62-2f4a260fd83a tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] Calling method '.version_select at 0x7fd456431670>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:25.488605 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f79f45ab-e57a-4dbf-ad62-2f4a260fd83a tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/8df4c06e-eaca-48c6-979c-bdb068ec11e9" status: 200 len: 350 microversion: 2.1 time: 0.408144 May 19 12:24:25.489225 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 4/10] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:24:25 2022] GET /compute/v2.1/os-volumes/8df4c06e-eaca-48c6-979c-bdb068ec11e9 => generated 350 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:25.501856 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-83ec1dd2-8579-43b4-9134-2b2f38e6d0f2 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] Calling method '.version_select at 0x7fd456c99b80>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:25.719435 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-83ec1dd2-8579-43b4-9134-2b2f38e6d0f2 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.221146 May 19 12:24:25.722999 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 7/11] 10.222.0.57 () {58 vars in 1133 bytes} [Thu May 19 12:24:25 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:25.741366 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a1c2b297-b7b6-496b-b9d0-a96a3a5914cc tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] Calling method '.version_select at 0x7fd4563b0550>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:25.741996 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-328da280-d13d-4acd-8c3c-90ee0d6462b6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:25.745316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-328da280-d13d-4acd-8c3c-90ee0d6462b6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:25.758427 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-328da280-d13d-4acd-8c3c-90ee0d6462b6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:25.759665 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-328da280-d13d-4acd-8c3c-90ee0d6462b6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:25.761570 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-328da280-d13d-4acd-8c3c-90ee0d6462b6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:25.764504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-328da280-d13d-4acd-8c3c-90ee0d6462b6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:25.974913 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a1c2b297-b7b6-496b-b9d0-a96a3a5914cc tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.243163 May 19 12:24:25.976124 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 5/12] 10.222.0.57 () {58 vars in 1148 bytes} [Thu May 19 12:24:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:25.990636 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-67415ce8-8354-465a-b545-ca5af2baaab8 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] Calling method '.version_select at 0x7fd4563c0040>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:26.071759 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-328da280-d13d-4acd-8c3c-90ee0d6462b6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:26.096882 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-328da280-d13d-4acd-8c3c-90ee0d6462b6 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1267 microversion: 2.1 time: 0.357658 May 19 12:24:26.101414 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 8/13] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:25 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1267 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:26.202297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-67415ce8-8354-465a-b545-ca5af2baaab8 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.215132 May 19 12:24:26.203867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 6/14] 10.222.0.57 () {58 vars in 1133 bytes} [Thu May 19 12:24:25 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:26.215144 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3be166c0-b88a-4f83-b89d-cc34efa9ec17 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] Calling method '.version_select at 0x7fd456c30670>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:26.591737 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3be166c0-b88a-4f83-b89d-cc34efa9ec17 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.380440 May 19 12:24:26.592753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 9/15] 10.222.0.57 () {58 vars in 1166 bytes} [Thu May 19 12:24:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:26.615874 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-22c8e7d4-3af4-40e9-8134-e1f363a16e8a tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] Calling method '.version_select at 0x7fd4563c0ca0>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:27.239181 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1748574968", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:27.427166 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] validate_networks() for [('be7a1bb6-7423-463b-a0ab-52779c3ad619', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:24:27.944424 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-22c8e7d4-3af4-40e9-8134-e1f363a16e8a tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 1.341109 May 19 12:24:27.944424 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 7/16] 10.222.0.57 () {58 vars in 1169 bytes} [Thu May 19 12:24:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:27.959985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6962cb34-9ec9-4d79-ba9d-d10e16716400 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:27.960608 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6962cb34-9ec9-4d79-ba9d-d10e16716400 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:27.969782 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6962cb34-9ec9-4d79-ba9d-d10e16716400 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:27.970400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6962cb34-9ec9-4d79-ba9d-d10e16716400 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:27.971758 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6962cb34-9ec9-4d79-ba9d-d10e16716400 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:27.972355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6962cb34-9ec9-4d79-ba9d-d10e16716400 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:28.252571 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:28.456341 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6962cb34-9ec9-4d79-ba9d-d10e16716400 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:28.465446 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6962cb34-9ec9-4d79-ba9d-d10e16716400 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1273 microversion: 2.1 time: 0.510665 May 19 12:24:28.476508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 8/17] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:27 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1273 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:28.492325 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-250143494", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89c57c7f-4a52-4f23-b0c9-a848f66927a4"}], "security_groups": [{"name": "tempest-securitygroup--1627313311"}], "key_name": "tempest-keypair-58744428", "user_data": "}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:29.142576 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.network.neutron [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] validate_networks() for [('89c57c7f-4a52-4f23-b0c9-a848f66927a4', None, None, None, None, None)] {{(pid=118112) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:24:30.220720 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:24:30.222095 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:24:30.222971 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:24:30.223554 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:24:30.224914 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:24:30.267883 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:30.268433 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:30.269154 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:30.269593 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:30.287923 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=8 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:30.323643 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Getting quotas for project d9e96ed4a3b5430298605d709d353f6e. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:24:30.330150 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Getting quotas for user 5c35bd3640694b0dbce13c713fd68306 and project d9e96ed4a3b5430298605d709d353f6e. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:24:30.350046 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:24:30.353966 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:24:30.493757 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Flavor limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:24:30.494273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Image limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:24:30.495063 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Flavor pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:24:30.495496 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Image pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:24:30.495922 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:24:30.540593 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:30.541770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:30.546191 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:30.558621 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:30.579907 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Getting quotas for project 4f4a6b5e282e45ffbef6963200558594. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:24:30.594168 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Getting quotas for user 707a899d6c5d4c4ea1c58e0de6a85b1d and project 4f4a6b5e282e45ffbef6963200558594. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:24:30.611038 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Going to run 1 instances... {{(pid=118112) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:24:30.614320 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:24:30.684342 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-faca983a-b39a-42f8-bf07-c80115adac90 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.841952 May 19 12:24:30.685766 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 10/18] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:24:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 3848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 12:24:30.693213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-02502a98-479e-463a-bc99-e28f59d76b9f tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] Calling method '.version_select at 0x7fd456b60310>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:30.885452 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-120f75df-65a3-4bc5-94c7-5b0f0e9db557 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.406617 May 19 12:24:30.886544 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 9/19] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:24:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 2408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:24:30.918842 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fc9a7fc2-6baa-4cdb-b933-cf1eeeb3dae3 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:30.919768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fc9a7fc2-6baa-4cdb-b933-cf1eeeb3dae3 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:30.968981 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc9a7fc2-6baa-4cdb-b933-cf1eeeb3dae3 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:30.976333 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc9a7fc2-6baa-4cdb-b933-cf1eeeb3dae3 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:30.977303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc9a7fc2-6baa-4cdb-b933-cf1eeeb3dae3 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:30.977752 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc9a7fc2-6baa-4cdb-b933-cf1eeeb3dae3 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:31.242162 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-02502a98-479e-463a-bc99-e28f59d76b9f tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.554386 May 19 12:24:31.243253 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 11/20] 10.222.0.57 () {58 vars in 1154 bytes} [Thu May 19 12:24:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:31.475371 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-312eb277-4c35-4227-9dd5-27eec9866a3d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Action: 'create', calling method: .version_select at 0x7fd456b60e50>, body: {"keypair": {"name": "tempest-keypair-1647004569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL3Ju8li6GVIYA8doPOJSayP1zOna3GjGqsZJWendImq2DBl3YSv7Rjo2UNr41I+grxvOP+Q/siZqxjIMyS7jQAWOnM2BE4pI9VdauZF/4Nspz4xvTI4QaP3eg2rI6VJw=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:31.509153 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-312eb277-4c35-4227-9dd5-27eec9866a3d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for project 86c353f6ded643e6b501ec57800fafc6. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:24:31.558171 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fc9a7fc2-6baa-4cdb-b933-cf1eeeb3dae3 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:31.567666 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-312eb277-4c35-4227-9dd5-27eec9866a3d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for user f0a98f1c068843a684f6765d41cc4e49 and project 86c353f6ded643e6b501ec57800fafc6. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:24:31.571156 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fc9a7fc2-6baa-4cdb-b933-cf1eeeb3dae3 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.679703 May 19 12:24:31.583615 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 10/21] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:30 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:31.591683 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9a20a0d7-9bca-4e07-ad73-d38a69046253 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:31.591683 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9a20a0d7-9bca-4e07-ad73-d38a69046253 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:31.720095 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-312eb277-4c35-4227-9dd5-27eec9866a3d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.474412 May 19 12:24:31.726953 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 12/22] 10.222.0.57 () {60 vars in 1158 bytes} [Thu May 19 12:24:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:31.726953 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4e3421d8-4d47-4635-bc5a-fd141b7c85fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:31.727611 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4e3421d8-4d47-4635-bc5a-fd141b7c85fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:31.885653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9a20a0d7-9bca-4e07-ad73-d38a69046253 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:31.977866 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9a20a0d7-9bca-4e07-ad73-d38a69046253 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1222 microversion: 2.1 time: 0.396927 May 19 12:24:31.986096 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 11/23] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:31 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1222 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:31.996114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4e3421d8-4d47-4635-bc5a-fd141b7c85fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:32.008532 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2cfd96a2-aee8-434f-96ba-04dd097a6374 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] Calling method '.version_select at 0x7fd4563daf70>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:32.113741 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4e3421d8-4d47-4635-bc5a-fd141b7c85fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1235 microversion: 2.1 time: 0.391229 May 19 12:24:32.120301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 13/24] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:31 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1235 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:32.279963 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-83bd5459-e51f-4df1-94cb-59336685ccff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Action: 'create', calling method: .version_select at 0x7fd456b75af0>, body: {"keypair": {"name": "tempest-keypair-443020323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1aevOuaf+REzEOPjiwkvGCkRpHADp6Xdtg4IoCPhzCCWkKOqCOTEKVtEoG2sZrNEohwxAfZhi6UjvEQunRlinpe1u5TdCBU8dGYofT53ozx5gnaMN7ueL78h7lzpiQPA=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:32.307465 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-83bd5459-e51f-4df1-94cb-59336685ccff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Getting quotas for project 1231585c94524ec199c47bd4f4162578. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:24:32.314382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-83bd5459-e51f-4df1-94cb-59336685ccff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Getting quotas for user 746a70534fe5419ebe6d5e97a7a041f1 and project 1231585c94524ec199c47bd4f4162578. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:24:32.325189 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2cfd96a2-aee8-434f-96ba-04dd097a6374 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.333733 May 19 12:24:32.326020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 12/25] 10.222.0.57 () {58 vars in 1187 bytes} [Thu May 19 12:24:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:32.336224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1905241378", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:32.494876 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.network.neutron [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] validate_networks() for [('be7a1bb6-7423-463b-a0ab-52779c3ad619', None, None, None, None, None)] {{(pid=118112) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:24:32.566267 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-83bd5459-e51f-4df1-94cb-59336685ccff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.438183 May 19 12:24:32.568700 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 14/26] 10.222.0.57 () {62 vars in 1199 bytes} [Thu May 19 12:24:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 447 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 12:24:32.589708 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-eb4d9406-c9b3-4653-be50-396002fef060 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] Calling method '.version_select at 0x7fd456b60430>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:32.986208 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-eb4d9406-c9b3-4653-be50-396002fef060 tempest-VolumesTestJSON-755981996 tempest-VolumesTestJSON-755981996-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.413202 May 19 12:24:32.992451 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 15/27] 10.222.0.57 () {58 vars in 1154 bytes} [Thu May 19 12:24:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:33.002203 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2280bbaf-9bcf-4575-b0c9-5f6ec3709544 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:33.006967 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2280bbaf-9bcf-4575-b0c9-5f6ec3709544 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:33.053697 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2280bbaf-9bcf-4575-b0c9-5f6ec3709544 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:33.055948 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2280bbaf-9bcf-4575-b0c9-5f6ec3709544 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:33.058693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2280bbaf-9bcf-4575-b0c9-5f6ec3709544 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:33.083896 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2280bbaf-9bcf-4575-b0c9-5f6ec3709544 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:34.058220 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2280bbaf-9bcf-4575-b0c9-5f6ec3709544 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:34.091122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2280bbaf-9bcf-4575-b0c9-5f6ec3709544 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 1.083294 May 19 12:24:34.096699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 16/28] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:32 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:34.128171 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-00da47fc-fbec-402f-8c55-35916f9501d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:34.129308 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-00da47fc-fbec-402f-8c55-35916f9501d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:34.147689 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00da47fc-fbec-402f-8c55-35916f9501d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:34.161978 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00da47fc-fbec-402f-8c55-35916f9501d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:34.163363 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00da47fc-fbec-402f-8c55-35916f9501d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:34.167404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00da47fc-fbec-402f-8c55-35916f9501d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:34.498085 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-00da47fc-fbec-402f-8c55-35916f9501d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:34.523415 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-00da47fc-fbec-402f-8c55-35916f9501d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1231 microversion: 2.1 time: 0.423392 May 19 12:24:34.524719 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 17/29] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:34 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1231 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:34.883684 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Flavor limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:24:34.884815 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Image limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:24:34.886084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Flavor pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:24:34.886707 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Image pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:24:34.887470 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:24:34.901816 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:34.902604 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:34.904083 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:34.904749 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:34.929779 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Getting quotas for project d9e96ed4a3b5430298605d709d353f6e. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:24:34.936725 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Getting quotas for user 5c35bd3640694b0dbce13c713fd68306 and project d9e96ed4a3b5430298605d709d353f6e. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:24:34.960303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Going to run 1 instances... {{(pid=118112) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:24:34.962912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:24:35.114377 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cd8cce4d-23fa-4452-8250-8c6642c51bee tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:35.115328 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cd8cce4d-23fa-4452-8250-8c6642c51bee tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:35.133047 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd8cce4d-23fa-4452-8250-8c6642c51bee tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.133514 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd8cce4d-23fa-4452-8250-8c6642c51bee tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:35.134306 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd8cce4d-23fa-4452-8250-8c6642c51bee tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:35.140964 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd8cce4d-23fa-4452-8250-8c6642c51bee tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:35.301554 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a6221136-9021-4208-9206-59c386e9e8a9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.973582 May 19 12:24:35.311928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 13/30] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:24:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:24:35.362837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ceaf237b-beb0-4c98-967c-f15d871f9047 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:35.365197 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ceaf237b-beb0-4c98-967c-f15d871f9047 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:36.170614 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ceaf237b-beb0-4c98-967c-f15d871f9047 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:36.185948 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ceaf237b-beb0-4c98-967c-f15d871f9047 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1222 microversion: 2.1 time: 0.867921 May 19 12:24:36.186742 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 14/31] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:35 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1222 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:36.196906 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f8603465-11c5-4bc7-b642-c1ae24f41951 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:36.200419 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f8603465-11c5-4bc7-b642-c1ae24f41951 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:36.221993 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8603465-11c5-4bc7-b642-c1ae24f41951 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:36.221993 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8603465-11c5-4bc7-b642-c1ae24f41951 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:36.225600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8603465-11c5-4bc7-b642-c1ae24f41951 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:36.226466 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8603465-11c5-4bc7-b642-c1ae24f41951 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:36.276320 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cd8cce4d-23fa-4452-8250-8c6642c51bee tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:36.290060 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cd8cce4d-23fa-4452-8250-8c6642c51bee tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 1.179844 May 19 12:24:36.308040 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 18/32] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:35 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:36.474664 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f8603465-11c5-4bc7-b642-c1ae24f41951 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:36.492781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f8603465-11c5-4bc7-b642-c1ae24f41951 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1295 microversion: 2.1 time: 0.303210 May 19 12:24:36.493387 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 15/33] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:36 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1295 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:37.210595 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1d1b0f02-3470-4671-9e8b-b03e277cc3c5 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:37.214913 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1d1b0f02-3470-4671-9e8b-b03e277cc3c5 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:37.321801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4016b591-2b61-43d5-a199-137e44ceb157 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:37.365834 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4016b591-2b61-43d5-a199-137e44ceb157 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:37.488416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4016b591-2b61-43d5-a199-137e44ceb157 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:37.495829 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4016b591-2b61-43d5-a199-137e44ceb157 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:37.506893 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4016b591-2b61-43d5-a199-137e44ceb157 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:37.507799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4016b591-2b61-43d5-a199-137e44ceb157 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:37.938217 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1d1b0f02-3470-4671-9e8b-b03e277cc3c5 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:37.977820 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1d1b0f02-3470-4671-9e8b-b03e277cc3c5 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1222 microversion: 2.1 time: 0.775310 May 19 12:24:37.982763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 19/34] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:37 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1222 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:38.008093 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-20e4a6de-937f-4a5d-bf03-5c9e4a98f3d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:38.008647 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-20e4a6de-937f-4a5d-bf03-5c9e4a98f3d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:38.050217 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-20e4a6de-937f-4a5d-bf03-5c9e4a98f3d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:38.056330 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-20e4a6de-937f-4a5d-bf03-5c9e4a98f3d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:38.059928 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-20e4a6de-937f-4a5d-bf03-5c9e4a98f3d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:38.068017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-20e4a6de-937f-4a5d-bf03-5c9e4a98f3d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:38.939394 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-20e4a6de-937f-4a5d-bf03-5c9e4a98f3d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:38.951491 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-20e4a6de-937f-4a5d-bf03-5c9e4a98f3d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1293 microversion: 2.1 time: 0.964526 May 19 12:24:38.956440 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 20/35] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:37 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1293 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:38.983497 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4016b591-2b61-43d5-a199-137e44ceb157 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:38.996874 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4016b591-2b61-43d5-a199-137e44ceb157 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 1.685980 May 19 12:24:39.006497 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 16/36] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:37 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:39.021888 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-085e88c8-17fd-411d-b79e-6d6cb384353a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:39.021888 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-085e88c8-17fd-411d-b79e-6d6cb384353a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:39.052319 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-085e88c8-17fd-411d-b79e-6d6cb384353a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.053319 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-085e88c8-17fd-411d-b79e-6d6cb384353a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.054522 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-085e88c8-17fd-411d-b79e-6d6cb384353a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.056453 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-085e88c8-17fd-411d-b79e-6d6cb384353a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.443638 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-389a762e-c240-4b22-b5d5-092ec41c4252 req-11f4382b-807d-415c-98d6-9754bf7b2246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29fc59e9-f88a-46c9-a0d8-c695f778541e", "tag": "82ec4d27-e4be-404b-a6d9-8404077c5070"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:39.494471 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-389a762e-c240-4b22-b5d5-092ec41c4252 req-11f4382b-807d-415c-98d6-9754bf7b2246 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.497049 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-389a762e-c240-4b22-b5d5-092ec41c4252 req-11f4382b-807d-415c-98d6-9754bf7b2246 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.627739 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-389a762e-c240-4b22-b5d5-092ec41c4252 req-11f4382b-807d-415c-98d6-9754bf7b2246 service nova] Creating event network-changed:82ec4d27-e4be-404b-a6d9-8404077c5070 for instance 29fc59e9-f88a-46c9-a0d8-c695f778541e on hv-cinder-77819 May 19 12:24:39.631692 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-389a762e-c240-4b22-b5d5-092ec41c4252 req-11f4382b-807d-415c-98d6-9754bf7b2246 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118111) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 12:24:39.643786 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8e7b3ca7-6334-4f39-ae28-eee37886ba08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.651711 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8e7b3ca7-6334-4f39-ae28-eee37886ba08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.658511 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8e7b3ca7-6334-4f39-ae28-eee37886ba08 None None] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:39.663100 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8e7b3ca7-6334-4f39-ae28-eee37886ba08 None None] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:39.711863 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.compute.rpcapi [None req-8e7b3ca7-6334-4f39-ae28-eee37886ba08 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 12:24:39.720133 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8e7b3ca7-6334-4f39-ae28-eee37886ba08 None None] Releasing lock "compute-rpcapi-router" {{(pid=118111) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 12:24:39.749055 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-085e88c8-17fd-411d-b79e-6d6cb384353a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:39.766617 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-085e88c8-17fd-411d-b79e-6d6cb384353a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1274 microversion: 2.1 time: 0.754320 May 19 12:24:39.772053 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 17/37] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:39 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1274 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:39.807439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8e7b3ca7-6334-4f39-ae28-eee37886ba08 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.848744 May 19 12:24:39.819810 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 21/38] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:39.981560 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3edd9568-47b1-4b39-bd90-6b70fa7c3aa4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:39.983644 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3edd9568-47b1-4b39-bd90-6b70fa7c3aa4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:40.017363 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3edd9568-47b1-4b39-bd90-6b70fa7c3aa4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:40.020174 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-aaa62ce1-cf72-4be6-8504-144f55eb32e7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:40.022291 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-aaa62ce1-cf72-4be6-8504-144f55eb32e7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:40.027783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3edd9568-47b1-4b39-bd90-6b70fa7c3aa4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:40.040804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3edd9568-47b1-4b39-bd90-6b70fa7c3aa4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:40.042734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3edd9568-47b1-4b39-bd90-6b70fa7c3aa4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:40.078917 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-aaa62ce1-cf72-4be6-8504-144f55eb32e7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:40.079846 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-aaa62ce1-cf72-4be6-8504-144f55eb32e7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:40.081278 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-aaa62ce1-cf72-4be6-8504-144f55eb32e7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:40.082079 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-aaa62ce1-cf72-4be6-8504-144f55eb32e7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:40.792476 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3edd9568-47b1-4b39-bd90-6b70fa7c3aa4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:40.820084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3edd9568-47b1-4b39-bd90-6b70fa7c3aa4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1293 microversion: 2.1 time: 0.844757 May 19 12:24:40.821647 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 18/39] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:39 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1293 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:40.831896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b39dcd22-f5d1-4336-9b6d-81ad7bdcbda3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:40.840960 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b39dcd22-f5d1-4336-9b6d-81ad7bdcbda3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:40.856132 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b39dcd22-f5d1-4336-9b6d-81ad7bdcbda3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:40.856522 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b39dcd22-f5d1-4336-9b6d-81ad7bdcbda3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:40.859465 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b39dcd22-f5d1-4336-9b6d-81ad7bdcbda3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:40.860895 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b39dcd22-f5d1-4336-9b6d-81ad7bdcbda3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:41.078595 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b39dcd22-f5d1-4336-9b6d-81ad7bdcbda3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:41.094738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b39dcd22-f5d1-4336-9b6d-81ad7bdcbda3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1280 microversion: 2.1 time: 0.270791 May 19 12:24:41.100082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 19/40] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:40 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1280 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:41.214053 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-aaa62ce1-cf72-4be6-8504-144f55eb32e7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:41.222953 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-aaa62ce1-cf72-4be6-8504-144f55eb32e7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 1.208898 May 19 12:24:41.223632 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 22/41] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:40 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:41.840526 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6dd89f45-b0ad-40ca-b35d-5bae99ada52b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:41.847862 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6dd89f45-b0ad-40ca-b35d-5bae99ada52b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:41.852186 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6dd89f45-b0ad-40ca-b35d-5bae99ada52b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:41.852676 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6dd89f45-b0ad-40ca-b35d-5bae99ada52b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:41.853456 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6dd89f45-b0ad-40ca-b35d-5bae99ada52b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:41.858125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6dd89f45-b0ad-40ca-b35d-5bae99ada52b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:42.117119 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8c75f42f-7d4d-46da-9119-32513bd8c726 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:42.117741 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8c75f42f-7d4d-46da-9119-32513bd8c726 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:42.138498 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8c75f42f-7d4d-46da-9119-32513bd8c726 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:42.142767 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8c75f42f-7d4d-46da-9119-32513bd8c726 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:42.146658 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8c75f42f-7d4d-46da-9119-32513bd8c726 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:42.147505 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8c75f42f-7d4d-46da-9119-32513bd8c726 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:43.172810 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8c75f42f-7d4d-46da-9119-32513bd8c726 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:43.190149 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6dd89f45-b0ad-40ca-b35d-5bae99ada52b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:43.198015 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6dd89f45-b0ad-40ca-b35d-5bae99ada52b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1293 microversion: 2.1 time: 1.363176 May 19 12:24:43.198656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 20/42] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:41 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1293 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:43.212329 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8c75f42f-7d4d-46da-9119-32513bd8c726 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1280 microversion: 2.1 time: 1.099356 May 19 12:24:43.220135 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 23/43] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:42 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1280 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:43.237218 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d5836d37-bc47-479d-8ba5-ab0251f967e2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:43.237844 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d5836d37-bc47-479d-8ba5-ab0251f967e2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:43.259587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5836d37-bc47-479d-8ba5-ab0251f967e2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:43.267221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5836d37-bc47-479d-8ba5-ab0251f967e2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:43.270282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5836d37-bc47-479d-8ba5-ab0251f967e2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:43.270990 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5836d37-bc47-479d-8ba5-ab0251f967e2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:43.656093 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d5836d37-bc47-479d-8ba5-ab0251f967e2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:43.694649 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d5836d37-bc47-479d-8ba5-ab0251f967e2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.488176 May 19 12:24:43.698245 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 21/44] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:43 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:44.244099 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-25f4eb44-7ac5-48fe-8e54-7ab2cecddc55 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:44.245386 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ca4c26d9-fc64-4ff3-bd1d-dd6ebd8331fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:44.247370 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ca4c26d9-fc64-4ff3-bd1d-dd6ebd8331fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:44.247619 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-25f4eb44-7ac5-48fe-8e54-7ab2cecddc55 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:44.271692 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca4c26d9-fc64-4ff3-bd1d-dd6ebd8331fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:44.272139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25f4eb44-7ac5-48fe-8e54-7ab2cecddc55 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:44.272139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25f4eb44-7ac5-48fe-8e54-7ab2cecddc55 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:44.272139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25f4eb44-7ac5-48fe-8e54-7ab2cecddc55 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:44.272139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25f4eb44-7ac5-48fe-8e54-7ab2cecddc55 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:44.276216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca4c26d9-fc64-4ff3-bd1d-dd6ebd8331fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:44.278473 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca4c26d9-fc64-4ff3-bd1d-dd6ebd8331fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:44.288865 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca4c26d9-fc64-4ff3-bd1d-dd6ebd8331fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:44.918351 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=4 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:45.443035 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ca4c26d9-fc64-4ff3-bd1d-dd6ebd8331fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:45.479987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ca4c26d9-fc64-4ff3-bd1d-dd6ebd8331fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 1.239842 May 19 12:24:45.483570 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 22/45] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:44 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:45.500495 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1321579594", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9b89124-2c1b-4572-adaf-f3ca44cc01f0"}], "security_groups": [{"name": "tempest-securitygroup--442716620"}], "key_name": "tempest-keypair-1647004569", "user_data": "}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:45.598654 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-25f4eb44-7ac5-48fe-8e54-7ab2cecddc55 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:45.639927 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-25f4eb44-7ac5-48fe-8e54-7ab2cecddc55 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 1.399543 May 19 12:24:45.641305 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 24/46] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:44 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:45.672566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4a8c23a1-9792-4f2b-9bff-dae47346d65e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:45.676441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4a8c23a1-9792-4f2b-9bff-dae47346d65e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:45.692956 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a8c23a1-9792-4f2b-9bff-dae47346d65e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:45.693781 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a8c23a1-9792-4f2b-9bff-dae47346d65e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:45.694831 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a8c23a1-9792-4f2b-9bff-dae47346d65e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:45.695560 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a8c23a1-9792-4f2b-9bff-dae47346d65e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:46.124412 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.network.neutron [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] validate_networks() for [('c9b89124-2c1b-4572-adaf-f3ca44cc01f0', None, None, None, None, None)] {{(pid=118112) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:24:46.185681 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=16 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:46.367198 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4a8c23a1-9792-4f2b-9bff-dae47346d65e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:46.387173 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4a8c23a1-9792-4f2b-9bff-dae47346d65e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.744139 May 19 12:24:46.388000 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 25/47] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:45 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:46.500888 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d9384c60-f586-4eda-b84b-8a73fc20848e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:46.521437 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d9384c60-f586-4eda-b84b-8a73fc20848e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:46.521437 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9384c60-f586-4eda-b84b-8a73fc20848e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:46.521437 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9384c60-f586-4eda-b84b-8a73fc20848e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:46.521437 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9384c60-f586-4eda-b84b-8a73fc20848e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:46.521863 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9384c60-f586-4eda-b84b-8a73fc20848e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:46.642157 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:46.767184 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d9384c60-f586-4eda-b84b-8a73fc20848e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:46.775055 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d9384c60-f586-4eda-b84b-8a73fc20848e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.278211 May 19 12:24:46.775646 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 26/48] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:46 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:46.785368 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3a5603a2-48b0-4538-aeff-05b7a116185a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:46.785368 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3a5603a2-48b0-4538-aeff-05b7a116185a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:46.792349 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a5603a2-48b0-4538-aeff-05b7a116185a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:46.792826 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a5603a2-48b0-4538-aeff-05b7a116185a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:46.793625 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a5603a2-48b0-4538-aeff-05b7a116185a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:46.794073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a5603a2-48b0-4538-aeff-05b7a116185a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:47.096685 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Flavor limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:24:47.097132 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Image limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:24:47.097608 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Flavor pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:24:47.098017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Image pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:24:47.098445 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:24:47.107446 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:47.107888 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:47.109211 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:47.109647 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:47.116762 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=73 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:47.130516 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for project 86c353f6ded643e6b501ec57800fafc6. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:24:47.133453 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3a5603a2-48b0-4538-aeff-05b7a116185a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:47.136395 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=77 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:47.136572 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for user f0a98f1c068843a684f6765d41cc4e49 and project 86c353f6ded643e6b501ec57800fafc6. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:24:47.143797 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3a5603a2-48b0-4538-aeff-05b7a116185a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.367076 May 19 12:24:47.144396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 27/49] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:46 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:47.150721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Going to run 1 instances... {{(pid=118112) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:24:47.153014 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:24:47.410131 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8d475b3e-e6fb-42da-963e-93df923189a7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:47.410789 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8d475b3e-e6fb-42da-963e-93df923189a7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:47.415651 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:47.435743 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8d475b3e-e6fb-42da-963e-93df923189a7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:47.439104 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8d475b3e-e6fb-42da-963e-93df923189a7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:47.440202 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8d475b3e-e6fb-42da-963e-93df923189a7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:47.441148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8d475b3e-e6fb-42da-963e-93df923189a7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:47.448684 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-12057a71-46fe-4e34-8a0d-a12c8bf57e27 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.960590 May 19 12:24:47.449355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 23/50] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:24:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:24:47.479672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f364179b-e748-4783-bfcf-220343e1b5f3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:47.480297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f364179b-e748-4783-bfcf-220343e1b5f3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:47.704028 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f364179b-e748-4783-bfcf-220343e1b5f3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:47.712366 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f364179b-e748-4783-bfcf-220343e1b5f3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1242 microversion: 2.1 time: 0.237268 May 19 12:24:47.716385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 24/51] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:47 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1242 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:47.792899 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2e42d24e-8a07-4bc5-b39b-90b87942ed05 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:47.793461 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2e42d24e-8a07-4bc5-b39b-90b87942ed05 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:47.801591 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2e42d24e-8a07-4bc5-b39b-90b87942ed05 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:47.802652 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2e42d24e-8a07-4bc5-b39b-90b87942ed05 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:47.803844 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2e42d24e-8a07-4bc5-b39b-90b87942ed05 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:47.804331 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2e42d24e-8a07-4bc5-b39b-90b87942ed05 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:47.952092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=26 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:48.080490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8d475b3e-e6fb-42da-963e-93df923189a7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:48.091106 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8d475b3e-e6fb-42da-963e-93df923189a7 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.686745 May 19 12:24:48.093087 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 28/52] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:47 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:48.114765 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-524820396", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95564b1d-433e-4b0e-8ac1-53dd3bc3d04f"}], "security_groups": [{"name": "tempest-securitygroup--1756601629"}], "key_name": "tempest-keypair-443020323", "user_data": "}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:48.135954 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2e42d24e-8a07-4bc5-b39b-90b87942ed05 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:48.154725 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2e42d24e-8a07-4bc5-b39b-90b87942ed05 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.365542 May 19 12:24:48.155396 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 25/53] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:47 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:48.180329 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-a6ad4ca4-eccc-4844-b084-75d4377463e6 req-c5140add-5af7-41b0-8356-9d2275f3db55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1", "tag": "b53cc247-1a43-4485-97e1-5c39672f1e3a"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:48.198673 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-a6ad4ca4-eccc-4844-b084-75d4377463e6 req-c5140add-5af7-41b0-8356-9d2275f3db55 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:48.199648 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-a6ad4ca4-eccc-4844-b084-75d4377463e6 req-c5140add-5af7-41b0-8356-9d2275f3db55 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:48.236207 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-a6ad4ca4-eccc-4844-b084-75d4377463e6 req-c5140add-5af7-41b0-8356-9d2275f3db55 service nova] Creating event network-changed:b53cc247-1a43-4485-97e1-5c39672f1e3a for instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 on hv-cinder-77819 May 19 12:24:48.239606 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-a6ad4ca4-eccc-4844-b084-75d4377463e6 req-c5140add-5af7-41b0-8356-9d2275f3db55 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118112) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 12:24:48.244983 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-12d10188-7518-43c0-a7d2-903762f2192e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:48.249107 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-12d10188-7518-43c0-a7d2-903762f2192e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:48.255153 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-12d10188-7518-43c0-a7d2-903762f2192e None None] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:48.256340 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-12d10188-7518-43c0-a7d2-903762f2192e None None] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:48.289980 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.compute.rpcapi [None req-12d10188-7518-43c0-a7d2-903762f2192e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 12:24:48.291600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-12d10188-7518-43c0-a7d2-903762f2192e None None] Releasing lock "compute-rpcapi-router" {{(pid=118112) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 12:24:48.345931 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-12d10188-7518-43c0-a7d2-903762f2192e None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173172 May 19 12:24:48.348059 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 26/54] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:48.361133 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-7cb54d08-afb1-4e5b-aaf4-b40a2f654559 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:48.362910 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-7cb54d08-afb1-4e5b-aaf4-b40a2f654559 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:48.372275 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7cb54d08-afb1-4e5b-aaf4-b40a2f654559 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:48.373059 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7cb54d08-afb1-4e5b-aaf4-b40a2f654559 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:48.375366 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7cb54d08-afb1-4e5b-aaf4-b40a2f654559 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:48.377208 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7cb54d08-afb1-4e5b-aaf4-b40a2f654559 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:48.786355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] validate_networks() for [('95564b1d-433e-4b0e-8ac1-53dd3bc3d04f', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:24:49.070783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-7cb54d08-afb1-4e5b-aaf4-b40a2f654559 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:49.102866 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-7cb54d08-afb1-4e5b-aaf4-b40a2f654559 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.753255 May 19 12:24:49.107591 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 27/55] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:48 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:49.118075 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-25cce8f8-ecdc-4bb2-aa42-a6d566322a45 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:49.123107 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-25cce8f8-ecdc-4bb2-aa42-a6d566322a45 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:49.231173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-25cce8f8-ecdc-4bb2-aa42-a6d566322a45 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:49.238281 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-25cce8f8-ecdc-4bb2-aa42-a6d566322a45 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1242 microversion: 2.1 time: 0.127551 May 19 12:24:49.238958 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 28/56] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:49 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:49.525840 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-340a9976-2143-4b0a-93c6-8e506e225db5 req-589cddef-6636-4c1d-b4b6-6174cfa27f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5b2145b-8dcb-4d81-af12-42d1494da298", "tag": "ead40d23-6a23-4073-ba08-29726edb0ac8"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:49.550064 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-340a9976-2143-4b0a-93c6-8e506e225db5 req-589cddef-6636-4c1d-b4b6-6174cfa27f47 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:49.550064 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-340a9976-2143-4b0a-93c6-8e506e225db5 req-589cddef-6636-4c1d-b4b6-6174cfa27f47 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:49.568687 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-340a9976-2143-4b0a-93c6-8e506e225db5 req-589cddef-6636-4c1d-b4b6-6174cfa27f47 service nova] Creating event network-changed:ead40d23-6a23-4073-ba08-29726edb0ac8 for instance d5b2145b-8dcb-4d81-af12-42d1494da298 on hv-cinder-77819 May 19 12:24:49.576803 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-340a9976-2143-4b0a-93c6-8e506e225db5 req-589cddef-6636-4c1d-b4b6-6174cfa27f47 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.336567 May 19 12:24:49.577455 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 29/57] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:24:49.583525 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d91ce7ae-6982-4072-832e-7259b592e45d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:49.584226 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d91ce7ae-6982-4072-832e-7259b592e45d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:49.592199 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d91ce7ae-6982-4072-832e-7259b592e45d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:49.592199 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d91ce7ae-6982-4072-832e-7259b592e45d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:49.593531 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d91ce7ae-6982-4072-832e-7259b592e45d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:49.593979 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d91ce7ae-6982-4072-832e-7259b592e45d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:49.721954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:49.725725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:24:49.726705 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:24:49.728145 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:24:49.729141 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:24:49.729717 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:24:49.746980 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:49.747613 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:49.748560 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:49.749160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:49.770089 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Getting quotas for project 1231585c94524ec199c47bd4f4162578. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:24:49.774887 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Getting quotas for user 746a70534fe5419ebe6d5e97a7a041f1 and project 1231585c94524ec199c47bd4f4162578. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:24:49.787896 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:24:49.790189 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:24:49.821782 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d91ce7ae-6982-4072-832e-7259b592e45d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:49.825997 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d91ce7ae-6982-4072-832e-7259b592e45d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.246851 May 19 12:24:49.826204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 30/58] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:49 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:49.831654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-214c531d-fbe2-48ae-a91e-f6963bb55e95 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:49.832568 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-214c531d-fbe2-48ae-a91e-f6963bb55e95 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:49.838889 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-214c531d-fbe2-48ae-a91e-f6963bb55e95 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:49.839574 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-214c531d-fbe2-48ae-a91e-f6963bb55e95 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:49.840506 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-214c531d-fbe2-48ae-a91e-f6963bb55e95 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:49.841091 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-214c531d-fbe2-48ae-a91e-f6963bb55e95 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:49.930687 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-500a3411-8a11-4aac-a2c3-f6ee1faedf64 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.836341 May 19 12:24:49.932031 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 29/59] 10.222.0.57 () {62 vars in 1187 bytes} [Thu May 19 12:24:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 1838 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 12:24:49.942340 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-86edf30c-b10e-45cc-9b71-991256c0ae29 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:49.943274 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-86edf30c-b10e-45cc-9b71-991256c0ae29 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:50.213517 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-86edf30c-b10e-45cc-9b71-991256c0ae29 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:50.217612 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-86edf30c-b10e-45cc-9b71-991256c0ae29 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:50.219616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-86edf30c-b10e-45cc-9b71-991256c0ae29 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:50.220734 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-86edf30c-b10e-45cc-9b71-991256c0ae29 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1280 microversion: 2.20 time: 0.282416 May 19 12:24:50.221289 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 30/60] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:24:49 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1280 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:50.229725 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-214c531d-fbe2-48ae-a91e-f6963bb55e95 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:50.238501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9a6c29c8-91a1-4c1b-8496-9c215500e045 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:50.253832 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9a6c29c8-91a1-4c1b-8496-9c215500e045 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:50.254908 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-214c531d-fbe2-48ae-a91e-f6963bb55e95 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.413512 May 19 12:24:50.254908 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 31/61] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:49 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:50.255217 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9a6c29c8-91a1-4c1b-8496-9c215500e045 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:50.255217 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9a6c29c8-91a1-4c1b-8496-9c215500e045 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:50.255217 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9a6c29c8-91a1-4c1b-8496-9c215500e045 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:50.255217 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9a6c29c8-91a1-4c1b-8496-9c215500e045 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:50.255979 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1427b9b0-8844-4abc-a7be-248b7cfa12ee tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:50.256602 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1427b9b0-8844-4abc-a7be-248b7cfa12ee tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:50.263465 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1427b9b0-8844-4abc-a7be-248b7cfa12ee tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:50.263918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1427b9b0-8844-4abc-a7be-248b7cfa12ee tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:50.264697 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1427b9b0-8844-4abc-a7be-248b7cfa12ee tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:50.265730 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1427b9b0-8844-4abc-a7be-248b7cfa12ee tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:50.368684 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1427b9b0-8844-4abc-a7be-248b7cfa12ee tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:50.378306 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1427b9b0-8844-4abc-a7be-248b7cfa12ee tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1246 microversion: 2.1 time: 0.126357 May 19 12:24:50.378927 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 32/62] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:50 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1246 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:50.453064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9a6c29c8-91a1-4c1b-8496-9c215500e045 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:50.461518 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9a6c29c8-91a1-4c1b-8496-9c215500e045 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.236588 May 19 12:24:50.462697 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 31/63] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:50 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:50.846892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-564c143e-f166-481c-bb0b-b4388b376f80 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:50.847511 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-564c143e-f166-481c-bb0b-b4388b376f80 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:50.854019 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-564c143e-f166-481c-bb0b-b4388b376f80 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:50.854522 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-564c143e-f166-481c-bb0b-b4388b376f80 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:50.855622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-564c143e-f166-481c-bb0b-b4388b376f80 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:50.858705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-564c143e-f166-481c-bb0b-b4388b376f80 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:51.019804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-564c143e-f166-481c-bb0b-b4388b376f80 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:51.032336 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-564c143e-f166-481c-bb0b-b4388b376f80 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.191072 May 19 12:24:51.032946 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 33/64] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:50 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:51.238365 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-acf9bb96-2bf6-4dae-98a6-394a582d79ae tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:51.239039 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-acf9bb96-2bf6-4dae-98a6-394a582d79ae tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:51.270252 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3f03cfaa-2e87-47bf-8b0c-753040e880f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:51.275837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3f03cfaa-2e87-47bf-8b0c-753040e880f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:51.284610 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3f03cfaa-2e87-47bf-8b0c-753040e880f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:51.285048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3f03cfaa-2e87-47bf-8b0c-753040e880f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:51.285971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3f03cfaa-2e87-47bf-8b0c-753040e880f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:51.286471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3f03cfaa-2e87-47bf-8b0c-753040e880f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:51.302804 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-acf9bb96-2bf6-4dae-98a6-394a582d79ae tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:51.311171 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-acf9bb96-2bf6-4dae-98a6-394a582d79ae tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:51.313855 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-acf9bb96-2bf6-4dae-98a6-394a582d79ae tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:51.315273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-acf9bb96-2bf6-4dae-98a6-394a582d79ae tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1280 microversion: 2.20 time: 0.080790 May 19 12:24:51.316058 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:24:51 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:51.397232 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ad7d6834-8326-4383-bdea-18fd210c57cc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:51.397849 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ad7d6834-8326-4383-bdea-18fd210c57cc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:51.404113 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad7d6834-8326-4383-bdea-18fd210c57cc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:51.404574 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad7d6834-8326-4383-bdea-18fd210c57cc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:51.405332 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad7d6834-8326-4383-bdea-18fd210c57cc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:51.405924 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad7d6834-8326-4383-bdea-18fd210c57cc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:51.441881 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3f03cfaa-2e87-47bf-8b0c-753040e880f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:51.450016 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3f03cfaa-2e87-47bf-8b0c-753040e880f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.184922 May 19 12:24:51.450662 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 34/66] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:51 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:51.474728 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ad7d6834-8326-4383-bdea-18fd210c57cc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:51.481982 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8ff69158-96b8-41cf-9e54-397ebe098265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:51.482669 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ad7d6834-8326-4383-bdea-18fd210c57cc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1246 microversion: 2.1 time: 0.089430 May 19 12:24:51.482796 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8ff69158-96b8-41cf-9e54-397ebe098265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:51.483261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 33/67] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:51 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:51.492750 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8ff69158-96b8-41cf-9e54-397ebe098265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:51.493617 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8ff69158-96b8-41cf-9e54-397ebe098265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:51.495023 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8ff69158-96b8-41cf-9e54-397ebe098265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:51.495806 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8ff69158-96b8-41cf-9e54-397ebe098265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:51.607833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-8fe944c8-d86a-49fb-a5fd-b0b43d4cb3d4 req-a12f12f7-850f-4ac4-bc5f-7863d38f3836 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e6669b-4005-4691-9a9e-42cd9f209a44", "tag": "8d75d107-85c3-4858-8b90-5ba107a81513"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:24:51.617417 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-8fe944c8-d86a-49fb-a5fd-b0b43d4cb3d4 req-a12f12f7-850f-4ac4-bc5f-7863d38f3836 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:51.617859 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-8fe944c8-d86a-49fb-a5fd-b0b43d4cb3d4 req-a12f12f7-850f-4ac4-bc5f-7863d38f3836 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:51.630264 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-8fe944c8-d86a-49fb-a5fd-b0b43d4cb3d4 req-a12f12f7-850f-4ac4-bc5f-7863d38f3836 service nova] Creating event network-changed:8d75d107-85c3-4858-8b90-5ba107a81513 for instance 99e6669b-4005-4691-9a9e-42cd9f209a44 on hv-cinder-77819 May 19 12:24:51.673722 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-8fe944c8-d86a-49fb-a5fd-b0b43d4cb3d4 req-a12f12f7-850f-4ac4-bc5f-7863d38f3836 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067233 May 19 12:24:51.673722 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 34/68] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:24:51.705967 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8ff69158-96b8-41cf-9e54-397ebe098265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:51.714973 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8ff69158-96b8-41cf-9e54-397ebe098265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.238590 May 19 12:24:51.715848 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 35/69] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:51 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:52.109998 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cf6463d3-84a4-4530-b56d-c319d0127924 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:52.109998 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cf6463d3-84a4-4530-b56d-c319d0127924 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:52.109998 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cf6463d3-84a4-4530-b56d-c319d0127924 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.109998 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cf6463d3-84a4-4530-b56d-c319d0127924 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.110839 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cf6463d3-84a4-4530-b56d-c319d0127924 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.110839 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cf6463d3-84a4-4530-b56d-c319d0127924 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.334431 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-040773ed-9627-4669-8b42-b977f21716f8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:52.335158 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-040773ed-9627-4669-8b42-b977f21716f8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:52.351280 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-040773ed-9627-4669-8b42-b977f21716f8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.351870 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-040773ed-9627-4669-8b42-b977f21716f8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.353018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-040773ed-9627-4669-8b42-b977f21716f8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.353545 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-040773ed-9627-4669-8b42-b977f21716f8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.480223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-040773ed-9627-4669-8b42-b977f21716f8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:52.494052 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-040773ed-9627-4669-8b42-b977f21716f8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:52.497244 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-040773ed-9627-4669-8b42-b977f21716f8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:52.501685 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-040773ed-9627-4669-8b42-b977f21716f8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1276 microversion: 2.20 time: 0.171284 May 19 12:24:52.505007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:24:52 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:52.508417 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cf6463d3-84a4-4530-b56d-c319d0127924 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:52.515508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8407c389-ecf6-4b93-a84c-430e2e1caba6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:52.518915 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8407c389-ecf6-4b93-a84c-430e2e1caba6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:52.523156 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cf6463d3-84a4-4530-b56d-c319d0127924 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.477369 May 19 12:24:52.524424 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 35/71] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:52 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:52.531506 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ee471025-94db-4042-a2e7-41262ab66a9a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:52.531506 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ee471025-94db-4042-a2e7-41262ab66a9a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:52.533648 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8407c389-ecf6-4b93-a84c-430e2e1caba6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.534123 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8407c389-ecf6-4b93-a84c-430e2e1caba6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.535008 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8407c389-ecf6-4b93-a84c-430e2e1caba6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.535707 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8407c389-ecf6-4b93-a84c-430e2e1caba6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.544583 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ee471025-94db-4042-a2e7-41262ab66a9a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.548897 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ee471025-94db-4042-a2e7-41262ab66a9a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.550054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ee471025-94db-4042-a2e7-41262ab66a9a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.553345 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ee471025-94db-4042-a2e7-41262ab66a9a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.679776 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ee471025-94db-4042-a2e7-41262ab66a9a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:52.691430 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ee471025-94db-4042-a2e7-41262ab66a9a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1294 microversion: 2.1 time: 0.165727 May 19 12:24:52.692874 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 36/72] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:52 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1294 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:52.733590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d9f36934-f811-4d1d-ac93-a0be86855d1f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:52.734916 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d9f36934-f811-4d1d-ac93-a0be86855d1f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:52.742720 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9f36934-f811-4d1d-ac93-a0be86855d1f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.743419 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9f36934-f811-4d1d-ac93-a0be86855d1f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.745204 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9f36934-f811-4d1d-ac93-a0be86855d1f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:52.745204 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d9f36934-f811-4d1d-ac93-a0be86855d1f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:52.802718 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8407c389-ecf6-4b93-a84c-430e2e1caba6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:52.812561 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8407c389-ecf6-4b93-a84c-430e2e1caba6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.304402 May 19 12:24:52.824555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 37/73] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:52 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:52.912642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d9f36934-f811-4d1d-ac93-a0be86855d1f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:52.920608 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d9f36934-f811-4d1d-ac93-a0be86855d1f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.191317 May 19 12:24:52.921843 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 37/74] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:52 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:53.524209 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6e153518-1350-4818-a867-5b268143f54d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:53.524804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6e153518-1350-4818-a867-5b268143f54d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:53.531223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e153518-1350-4818-a867-5b268143f54d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:53.531677 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e153518-1350-4818-a867-5b268143f54d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:53.532433 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e153518-1350-4818-a867-5b268143f54d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:53.532868 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e153518-1350-4818-a867-5b268143f54d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:53.549780 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-62b4c196-9273-4560-afad-96cf2542e35e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:53.550484 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-62b4c196-9273-4560-afad-96cf2542e35e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:53.557161 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-62b4c196-9273-4560-afad-96cf2542e35e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:53.557616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-62b4c196-9273-4560-afad-96cf2542e35e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:53.558415 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-62b4c196-9273-4560-afad-96cf2542e35e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:53.558852 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-62b4c196-9273-4560-afad-96cf2542e35e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:53.613269 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6e153518-1350-4818-a867-5b268143f54d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:53.625047 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6e153518-1350-4818-a867-5b268143f54d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:53.626748 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6e153518-1350-4818-a867-5b268143f54d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:53.627886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6e153518-1350-4818-a867-5b268143f54d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1332 microversion: 2.20 time: 0.107729 May 19 12:24:53.638391 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 38/75] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:24:53 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1332 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:53.711272 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-268b8b50-18de-47aa-80f7-8d3cd68bcb41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:53.711887 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-268b8b50-18de-47aa-80f7-8d3cd68bcb41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:53.719391 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-62b4c196-9273-4560-afad-96cf2542e35e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:53.726302 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-268b8b50-18de-47aa-80f7-8d3cd68bcb41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:53.726302 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-268b8b50-18de-47aa-80f7-8d3cd68bcb41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:53.727400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-268b8b50-18de-47aa-80f7-8d3cd68bcb41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:53.727813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-62b4c196-9273-4560-afad-96cf2542e35e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.183860 May 19 12:24:53.727927 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-268b8b50-18de-47aa-80f7-8d3cd68bcb41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:53.728708 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 38/76] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:53 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:53.830909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b2f22f49-22a4-4361-8737-e7e3bf90069f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:53.831659 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b2f22f49-22a4-4361-8737-e7e3bf90069f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:53.839472 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b2f22f49-22a4-4361-8737-e7e3bf90069f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:53.840203 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b2f22f49-22a4-4361-8737-e7e3bf90069f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:53.843647 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b2f22f49-22a4-4361-8737-e7e3bf90069f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:53.844624 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b2f22f49-22a4-4361-8737-e7e3bf90069f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:53.959882 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-268b8b50-18de-47aa-80f7-8d3cd68bcb41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:53.970352 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-268b8b50-18de-47aa-80f7-8d3cd68bcb41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1294 microversion: 2.1 time: 0.262716 May 19 12:24:53.982281 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 39/77] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:53 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1294 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:53.988864 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0a2b9d20-d167-4db8-a079-360b12ca6ac2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:53.989809 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0a2b9d20-d167-4db8-a079-360b12ca6ac2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:53.997204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0a2b9d20-d167-4db8-a079-360b12ca6ac2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:53.998078 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0a2b9d20-d167-4db8-a079-360b12ca6ac2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:53.999205 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0a2b9d20-d167-4db8-a079-360b12ca6ac2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:54.016129 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0a2b9d20-d167-4db8-a079-360b12ca6ac2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:54.116463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b2f22f49-22a4-4361-8737-e7e3bf90069f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:54.124854 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b2f22f49-22a4-4361-8737-e7e3bf90069f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.298475 May 19 12:24:54.125674 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 39/78] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:53 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:54.179822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0a2b9d20-d167-4db8-a079-360b12ca6ac2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:54.195217 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0a2b9d20-d167-4db8-a079-360b12ca6ac2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.211654 May 19 12:24:54.195819 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 40/79] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:53 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:54.645492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-93d8f20d-75a3-47bd-b174-9493e5d4d036 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:54.646094 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-93d8f20d-75a3-47bd-b174-9493e5d4d036 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:54.653285 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-93d8f20d-75a3-47bd-b174-9493e5d4d036 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:54.653285 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-93d8f20d-75a3-47bd-b174-9493e5d4d036 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:54.653767 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-93d8f20d-75a3-47bd-b174-9493e5d4d036 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:54.654207 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-93d8f20d-75a3-47bd-b174-9493e5d4d036 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:54.716235 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-93d8f20d-75a3-47bd-b174-9493e5d4d036 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:54.724754 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-93d8f20d-75a3-47bd-b174-9493e5d4d036 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:54.726270 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-93d8f20d-75a3-47bd-b174-9493e5d4d036 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:54.727405 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-93d8f20d-75a3-47bd-b174-9493e5d4d036 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1332 microversion: 2.20 time: 0.085940 May 19 12:24:54.727973 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 40/80] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:24:54 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1332 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:24:54.745021 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-384b058e-c395-4595-b2ba-52917f7f3f71 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:54.748251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-384b058e-c395-4595-b2ba-52917f7f3f71 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:54.752604 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-384b058e-c395-4595-b2ba-52917f7f3f71 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:54.753052 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-384b058e-c395-4595-b2ba-52917f7f3f71 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:54.753875 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-384b058e-c395-4595-b2ba-52917f7f3f71 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:54.754282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-384b058e-c395-4595-b2ba-52917f7f3f71 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:54.889354 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-384b058e-c395-4595-b2ba-52917f7f3f71 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:54.897666 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-384b058e-c395-4595-b2ba-52917f7f3f71 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.156546 May 19 12:24:54.898251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 41/81] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:54 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:54.989569 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-92c95146-6fee-4ec0-b6f2-e6d0fedd1ade tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:54.990176 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-92c95146-6fee-4ec0-b6f2-e6d0fedd1ade tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:54.997188 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92c95146-6fee-4ec0-b6f2-e6d0fedd1ade tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:54.997581 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92c95146-6fee-4ec0-b6f2-e6d0fedd1ade tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:54.998361 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92c95146-6fee-4ec0-b6f2-e6d0fedd1ade tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:54.998827 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92c95146-6fee-4ec0-b6f2-e6d0fedd1ade tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:55.072981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-92c95146-6fee-4ec0-b6f2-e6d0fedd1ade tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:55.082089 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-92c95146-6fee-4ec0-b6f2-e6d0fedd1ade tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1294 microversion: 2.1 time: 0.096397 May 19 12:24:55.082714 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 41/82] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:54 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:55.143736 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-33d32b61-c53c-4528-8eec-585cccbae18d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:55.144483 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-33d32b61-c53c-4528-8eec-585cccbae18d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:55.159942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-33d32b61-c53c-4528-8eec-585cccbae18d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:55.159942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-33d32b61-c53c-4528-8eec-585cccbae18d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:55.159942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-33d32b61-c53c-4528-8eec-585cccbae18d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:55.159942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-33d32b61-c53c-4528-8eec-585cccbae18d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:55.214938 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-14f2db61-f762-4f70-8813-e40076b7ac67 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:55.215779 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-14f2db61-f762-4f70-8813-e40076b7ac67 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:55.225856 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-14f2db61-f762-4f70-8813-e40076b7ac67 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:55.226632 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-14f2db61-f762-4f70-8813-e40076b7ac67 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:55.227834 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-14f2db61-f762-4f70-8813-e40076b7ac67 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:55.228549 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-14f2db61-f762-4f70-8813-e40076b7ac67 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:55.347196 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-33d32b61-c53c-4528-8eec-585cccbae18d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:55.355038 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-33d32b61-c53c-4528-8eec-585cccbae18d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.216451 May 19 12:24:55.364813 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 42/83] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:55 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:55.435292 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-14f2db61-f762-4f70-8813-e40076b7ac67 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:55.443176 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-14f2db61-f762-4f70-8813-e40076b7ac67 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.233889 May 19 12:24:55.444124 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 42/84] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:55 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:55.745004 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6bbe2f6c-e052-4ff7-8c11-b195c8f1d04d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:55.745603 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6bbe2f6c-e052-4ff7-8c11-b195c8f1d04d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:55.753792 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6bbe2f6c-e052-4ff7-8c11-b195c8f1d04d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:55.754328 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6bbe2f6c-e052-4ff7-8c11-b195c8f1d04d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:55.755221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6bbe2f6c-e052-4ff7-8c11-b195c8f1d04d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:55.755712 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6bbe2f6c-e052-4ff7-8c11-b195c8f1d04d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:55.772375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:55.829904 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6bbe2f6c-e052-4ff7-8c11-b195c8f1d04d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:55.837709 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6bbe2f6c-e052-4ff7-8c11-b195c8f1d04d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:55.839261 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6bbe2f6c-e052-4ff7-8c11-b195c8f1d04d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:55.840409 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6bbe2f6c-e052-4ff7-8c11-b195c8f1d04d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1332 microversion: 2.20 time: 0.099272 May 19 12:24:55.840973 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 43/85] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:24:55 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:55.917751 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b33104e3-086c-4e35-854e-cad03a92182e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:55.919055 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b33104e3-086c-4e35-854e-cad03a92182e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:55.930237 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b33104e3-086c-4e35-854e-cad03a92182e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:55.931118 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b33104e3-086c-4e35-854e-cad03a92182e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:55.931910 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b33104e3-086c-4e35-854e-cad03a92182e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:55.932356 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b33104e3-086c-4e35-854e-cad03a92182e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:56.099784 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2f2be447-db17-4817-afee-f34eabf61dde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:56.100638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2f2be447-db17-4817-afee-f34eabf61dde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:56.109759 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f2be447-db17-4817-afee-f34eabf61dde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:56.110214 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f2be447-db17-4817-afee-f34eabf61dde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:56.111042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f2be447-db17-4817-afee-f34eabf61dde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:56.111543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f2be447-db17-4817-afee-f34eabf61dde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:56.127145 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b33104e3-086c-4e35-854e-cad03a92182e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:56.135003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b33104e3-086c-4e35-854e-cad03a92182e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.224145 May 19 12:24:56.136132 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 43/86] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:55 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:56.183713 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2f2be447-db17-4817-afee-f34eabf61dde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:56.192725 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2f2be447-db17-4817-afee-f34eabf61dde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1294 microversion: 2.1 time: 0.097346 May 19 12:24:56.193630 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 44/87] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:56 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:56.372724 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f0dc45dc-2792-43fb-ba4f-c0bd0e03e188 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:56.373334 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f0dc45dc-2792-43fb-ba4f-c0bd0e03e188 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:56.380431 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f0dc45dc-2792-43fb-ba4f-c0bd0e03e188 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:56.380958 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f0dc45dc-2792-43fb-ba4f-c0bd0e03e188 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:56.381815 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f0dc45dc-2792-43fb-ba4f-c0bd0e03e188 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:56.382343 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f0dc45dc-2792-43fb-ba4f-c0bd0e03e188 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:56.460784 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5ec82d53-c6d9-442f-9ed5-ba12bb5f49fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:56.461541 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5ec82d53-c6d9-442f-9ed5-ba12bb5f49fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:56.469663 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5ec82d53-c6d9-442f-9ed5-ba12bb5f49fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:56.470252 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5ec82d53-c6d9-442f-9ed5-ba12bb5f49fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:56.471299 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5ec82d53-c6d9-442f-9ed5-ba12bb5f49fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:56.471739 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5ec82d53-c6d9-442f-9ed5-ba12bb5f49fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:56.589867 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f0dc45dc-2792-43fb-ba4f-c0bd0e03e188 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:56.599402 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f0dc45dc-2792-43fb-ba4f-c0bd0e03e188 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.230660 May 19 12:24:56.600173 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 44/88] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:56 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:56.637589 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5ec82d53-c6d9-442f-9ed5-ba12bb5f49fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:56.645968 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5ec82d53-c6d9-442f-9ed5-ba12bb5f49fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.189151 May 19 12:24:56.646558 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 45/89] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:56 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:56.860149 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8c47e524-e607-4010-8b56-b0b552c1dc4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:56.860787 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8c47e524-e607-4010-8b56-b0b552c1dc4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:56.867215 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8c47e524-e607-4010-8b56-b0b552c1dc4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:56.867661 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8c47e524-e607-4010-8b56-b0b552c1dc4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:56.868427 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8c47e524-e607-4010-8b56-b0b552c1dc4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:56.868862 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8c47e524-e607-4010-8b56-b0b552c1dc4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:56.941541 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8c47e524-e607-4010-8b56-b0b552c1dc4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:56.955183 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8c47e524-e607-4010-8b56-b0b552c1dc4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:56.956701 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8c47e524-e607-4010-8b56-b0b552c1dc4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:56.962516 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8c47e524-e607-4010-8b56-b0b552c1dc4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1332 microversion: 2.20 time: 0.106904 May 19 12:24:56.963261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 45/90] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:24:56 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:24:57.151965 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a954618b-46e3-4b96-b056-f191469dcde9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:57.152581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a954618b-46e3-4b96-b056-f191469dcde9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:57.159423 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a954618b-46e3-4b96-b056-f191469dcde9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.159869 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a954618b-46e3-4b96-b056-f191469dcde9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:57.160639 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a954618b-46e3-4b96-b056-f191469dcde9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.161075 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a954618b-46e3-4b96-b056-f191469dcde9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:57.210447 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3e5ccf05-6ffd-41aa-8049-225551a68df8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:57.211303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3e5ccf05-6ffd-41aa-8049-225551a68df8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:57.220461 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3e5ccf05-6ffd-41aa-8049-225551a68df8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.222972 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3e5ccf05-6ffd-41aa-8049-225551a68df8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:57.223786 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3e5ccf05-6ffd-41aa-8049-225551a68df8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.224453 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3e5ccf05-6ffd-41aa-8049-225551a68df8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:57.298208 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3e5ccf05-6ffd-41aa-8049-225551a68df8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:57.309409 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3e5ccf05-6ffd-41aa-8049-225551a68df8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1294 microversion: 2.1 time: 0.102885 May 19 12:24:57.310417 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 46/91] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:57 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:57.356156 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a954618b-46e3-4b96-b056-f191469dcde9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:57.364482 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a954618b-46e3-4b96-b056-f191469dcde9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.216682 May 19 12:24:57.365066 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 46/92] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:57 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:57.617174 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2e8463e8-e5ee-41fd-a485-6efdc91dacf1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:57.617876 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2e8463e8-e5ee-41fd-a485-6efdc91dacf1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:57.625631 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2e8463e8-e5ee-41fd-a485-6efdc91dacf1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.626080 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2e8463e8-e5ee-41fd-a485-6efdc91dacf1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:57.626879 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2e8463e8-e5ee-41fd-a485-6efdc91dacf1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.627311 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2e8463e8-e5ee-41fd-a485-6efdc91dacf1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:57.663116 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-55766db1-6ada-4b77-91c1-d966cdd01247 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:57.663866 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-55766db1-6ada-4b77-91c1-d966cdd01247 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:57.670162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55766db1-6ada-4b77-91c1-d966cdd01247 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.670729 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55766db1-6ada-4b77-91c1-d966cdd01247 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:57.672156 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55766db1-6ada-4b77-91c1-d966cdd01247 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.672841 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55766db1-6ada-4b77-91c1-d966cdd01247 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:57.821726 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2e8463e8-e5ee-41fd-a485-6efdc91dacf1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:57.824392 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:57.833497 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2e8463e8-e5ee-41fd-a485-6efdc91dacf1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.220945 May 19 12:24:57.834430 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 47/93] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:57 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:57.870310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-55766db1-6ada-4b77-91c1-d966cdd01247 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:57.879852 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-55766db1-6ada-4b77-91c1-d966cdd01247 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.220488 May 19 12:24:57.880742 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 47/94] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:57 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:24:57.981548 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cd293bed-ce2d-4d52-b8ac-86851f4182a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:57.982166 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cd293bed-ce2d-4d52-b8ac-86851f4182a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:57.990023 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd293bed-ce2d-4d52-b8ac-86851f4182a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.990577 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd293bed-ce2d-4d52-b8ac-86851f4182a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:57.991364 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd293bed-ce2d-4d52-b8ac-86851f4182a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:57.991805 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd293bed-ce2d-4d52-b8ac-86851f4182a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:58.070445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cd293bed-ce2d-4d52-b8ac-86851f4182a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:58.079264 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cd293bed-ce2d-4d52-b8ac-86851f4182a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:58.081036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cd293bed-ce2d-4d52-b8ac-86851f4182a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:58.082152 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cd293bed-ce2d-4d52-b8ac-86851f4182a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1332 microversion: 2.20 time: 0.104615 May 19 12:24:58.082744 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 48/95] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:24:57 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:24:58.328752 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f549bcdb-f3be-441c-8f14-88f54f2ba75f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:58.329526 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f549bcdb-f3be-441c-8f14-88f54f2ba75f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:58.332498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=4 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:58.341311 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f549bcdb-f3be-441c-8f14-88f54f2ba75f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:58.341311 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f549bcdb-f3be-441c-8f14-88f54f2ba75f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:58.341311 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f549bcdb-f3be-441c-8f14-88f54f2ba75f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:58.341311 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f549bcdb-f3be-441c-8f14-88f54f2ba75f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:58.383151 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-70b059c3-7ffa-426f-9294-9a0434884fb9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:58.383945 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-70b059c3-7ffa-426f-9294-9a0434884fb9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:58.391175 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-70b059c3-7ffa-426f-9294-9a0434884fb9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:58.392494 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-70b059c3-7ffa-426f-9294-9a0434884fb9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:58.393488 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-70b059c3-7ffa-426f-9294-9a0434884fb9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:58.393922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-70b059c3-7ffa-426f-9294-9a0434884fb9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:58.416617 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f549bcdb-f3be-441c-8f14-88f54f2ba75f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:58.425699 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f549bcdb-f3be-441c-8f14-88f54f2ba75f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1294 microversion: 2.1 time: 0.101839 May 19 12:24:58.426290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 48/96] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:58 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1294 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:58.553358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-70b059c3-7ffa-426f-9294-9a0434884fb9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:58.560145 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-70b059c3-7ffa-426f-9294-9a0434884fb9 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.181287 May 19 12:24:58.561362 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 49/97] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:58 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:58.850510 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3cc462f2-7187-4c35-8a89-b6d809a9e607 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:58.851494 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3cc462f2-7187-4c35-8a89-b6d809a9e607 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:58.857745 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cc462f2-7187-4c35-8a89-b6d809a9e607 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:58.858584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cc462f2-7187-4c35-8a89-b6d809a9e607 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:58.859798 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cc462f2-7187-4c35-8a89-b6d809a9e607 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:58.860414 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cc462f2-7187-4c35-8a89-b6d809a9e607 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:58.902737 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-52a0d730-6d8a-45de-aed4-a00408fd19a2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:58.903570 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-52a0d730-6d8a-45de-aed4-a00408fd19a2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:58.911880 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-52a0d730-6d8a-45de-aed4-a00408fd19a2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:58.912326 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-52a0d730-6d8a-45de-aed4-a00408fd19a2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:58.913131 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-52a0d730-6d8a-45de-aed4-a00408fd19a2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:58.913737 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-52a0d730-6d8a-45de-aed4-a00408fd19a2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:59.067647 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3cc462f2-7187-4c35-8a89-b6d809a9e607 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:59.075397 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3cc462f2-7187-4c35-8a89-b6d809a9e607 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.228860 May 19 12:24:59.076198 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 49/98] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:58 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:59.109260 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-52a0d730-6d8a-45de-aed4-a00408fd19a2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:59.115541 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0bff0872-64a5-4aeb-9e6f-957e9e36f086 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:59.120065 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0bff0872-64a5-4aeb-9e6f-957e9e36f086 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:59.120205 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-52a0d730-6d8a-45de-aed4-a00408fd19a2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.225857 May 19 12:24:59.120411 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 50/99] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:58 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:59.127756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0bff0872-64a5-4aeb-9e6f-957e9e36f086 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:59.128857 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0bff0872-64a5-4aeb-9e6f-957e9e36f086 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:59.129431 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0bff0872-64a5-4aeb-9e6f-957e9e36f086 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:59.129869 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0bff0872-64a5-4aeb-9e6f-957e9e36f086 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:59.201895 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0bff0872-64a5-4aeb-9e6f-957e9e36f086 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:59.210709 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0bff0872-64a5-4aeb-9e6f-957e9e36f086 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:59.212205 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0bff0872-64a5-4aeb-9e6f-957e9e36f086 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:59.213323 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0bff0872-64a5-4aeb-9e6f-957e9e36f086 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1332 microversion: 2.20 time: 0.108569 May 19 12:24:59.213890 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 50/100] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:24:59 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:24:59.442954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-81335b1d-912e-4a07-95bd-6bc741e51454 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:59.443597 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-81335b1d-912e-4a07-95bd-6bc741e51454 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:59.449799 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81335b1d-912e-4a07-95bd-6bc741e51454 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:59.450243 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81335b1d-912e-4a07-95bd-6bc741e51454 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:59.451136 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81335b1d-912e-4a07-95bd-6bc741e51454 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:59.451568 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81335b1d-912e-4a07-95bd-6bc741e51454 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:59.515808 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-81335b1d-912e-4a07-95bd-6bc741e51454 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:59.524115 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-81335b1d-912e-4a07-95bd-6bc741e51454 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1294 microversion: 2.1 time: 0.084879 May 19 12:24:59.524758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 51/101] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:59 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:24:59.580716 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5357ba5a-acd2-4e85-abad-11969ca62833 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:24:59.581693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5357ba5a-acd2-4e85-abad-11969ca62833 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:24:59.585685 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=10 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:24:59.592350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5357ba5a-acd2-4e85-abad-11969ca62833 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:59.592350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5357ba5a-acd2-4e85-abad-11969ca62833 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:59.592350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5357ba5a-acd2-4e85-abad-11969ca62833 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:24:59.592350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5357ba5a-acd2-4e85-abad-11969ca62833 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:24:59.732363 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5357ba5a-acd2-4e85-abad-11969ca62833 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:24:59.742076 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5357ba5a-acd2-4e85-abad-11969ca62833 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.165671 May 19 12:24:59.742683 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 51/102] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:24:59 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:00.093851 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7ea04c4e-a9cc-4956-8d8c-81df4589cf53 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:00.094495 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7ea04c4e-a9cc-4956-8d8c-81df4589cf53 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:00.100786 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7ea04c4e-a9cc-4956-8d8c-81df4589cf53 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.101233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7ea04c4e-a9cc-4956-8d8c-81df4589cf53 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.102021 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7ea04c4e-a9cc-4956-8d8c-81df4589cf53 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.102481 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7ea04c4e-a9cc-4956-8d8c-81df4589cf53 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.136599 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6631117b-a35d-4958-a951-b5ab282258cb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:00.137322 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6631117b-a35d-4958-a951-b5ab282258cb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:00.145049 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6631117b-a35d-4958-a951-b5ab282258cb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.145588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6631117b-a35d-4958-a951-b5ab282258cb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.146372 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6631117b-a35d-4958-a951-b5ab282258cb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.146829 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6631117b-a35d-4958-a951-b5ab282258cb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.286543 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7ea04c4e-a9cc-4956-8d8c-81df4589cf53 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:00.294564 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7ea04c4e-a9cc-4956-8d8c-81df4589cf53 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.205379 May 19 12:25:00.295183 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 52/103] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:00 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:00.307468 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1781ece8-a300-4690-af59-77a57b10d0a7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:00.307468 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1781ece8-a300-4690-af59-77a57b10d0a7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:00.314823 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1781ece8-a300-4690-af59-77a57b10d0a7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.315273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1781ece8-a300-4690-af59-77a57b10d0a7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.316044 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1781ece8-a300-4690-af59-77a57b10d0a7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.316472 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1781ece8-a300-4690-af59-77a57b10d0a7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.329184 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6631117b-a35d-4958-a951-b5ab282258cb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:00.338523 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6631117b-a35d-4958-a951-b5ab282258cb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.204798 May 19 12:25:00.339785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 52/104] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:00 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:00.395282 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1781ece8-a300-4690-af59-77a57b10d0a7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:00.404371 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1781ece8-a300-4690-af59-77a57b10d0a7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:00.406897 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1781ece8-a300-4690-af59-77a57b10d0a7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:00.408118 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1781ece8-a300-4690-af59-77a57b10d0a7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1332 microversion: 2.20 time: 0.111968 May 19 12:25:00.408775 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 53/105] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:00 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:00.543037 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3ecf8191-c9e2-4cc6-b367-aa21497c658a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:00.543893 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3ecf8191-c9e2-4cc6-b367-aa21497c658a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:00.552656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3ecf8191-c9e2-4cc6-b367-aa21497c658a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.553105 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3ecf8191-c9e2-4cc6-b367-aa21497c658a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.553896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3ecf8191-c9e2-4cc6-b367-aa21497c658a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.554334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3ecf8191-c9e2-4cc6-b367-aa21497c658a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.630669 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3ecf8191-c9e2-4cc6-b367-aa21497c658a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:00.638601 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3ecf8191-c9e2-4cc6-b367-aa21497c658a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1294 microversion: 2.1 time: 0.100270 May 19 12:25:00.639197 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 53/106] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:00 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:00.761024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-210f9763-5169-44b3-8659-21a3cf232e4d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:00.761693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-210f9763-5169-44b3-8659-21a3cf232e4d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:00.768790 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-210f9763-5169-44b3-8659-21a3cf232e4d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.769268 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-210f9763-5169-44b3-8659-21a3cf232e4d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.770051 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-210f9763-5169-44b3-8659-21a3cf232e4d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:00.770503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-210f9763-5169-44b3-8659-21a3cf232e4d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:00.927742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-210f9763-5169-44b3-8659-21a3cf232e4d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:00.936062 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-210f9763-5169-44b3-8659-21a3cf232e4d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.179307 May 19 12:25:00.936870 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 54/107] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:00 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:01.312831 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-17e1c492-658c-4637-95f8-ebc03017debf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:01.313516 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-17e1c492-658c-4637-95f8-ebc03017debf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:01.320177 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-17e1c492-658c-4637-95f8-ebc03017debf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.320631 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-17e1c492-658c-4637-95f8-ebc03017debf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:01.321514 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-17e1c492-658c-4637-95f8-ebc03017debf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.321948 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-17e1c492-658c-4637-95f8-ebc03017debf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:01.356517 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-07ba94ff-a1f6-4450-a664-05c43322af5f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:01.357195 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-07ba94ff-a1f6-4450-a664-05c43322af5f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:01.359062 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=10 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:01.368960 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07ba94ff-a1f6-4450-a664-05c43322af5f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.369401 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07ba94ff-a1f6-4450-a664-05c43322af5f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:01.370170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07ba94ff-a1f6-4450-a664-05c43322af5f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.370650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07ba94ff-a1f6-4450-a664-05c43322af5f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:01.535709 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-17e1c492-658c-4637-95f8-ebc03017debf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:01.547723 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-17e1c492-658c-4637-95f8-ebc03017debf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.238882 May 19 12:25:01.548459 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 54/108] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:01 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:01.558147 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c1925854-e508-4ef5-9dc7-aa17bffbe0cd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:01.559631 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c1925854-e508-4ef5-9dc7-aa17bffbe0cd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:01.564754 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-07ba94ff-a1f6-4450-a664-05c43322af5f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:01.573542 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-07ba94ff-a1f6-4450-a664-05c43322af5f tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.220720 May 19 12:25:01.585442 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 55/109] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:01 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:01.586220 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c1925854-e508-4ef5-9dc7-aa17bffbe0cd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.586220 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c1925854-e508-4ef5-9dc7-aa17bffbe0cd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:01.586220 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c1925854-e508-4ef5-9dc7-aa17bffbe0cd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.586220 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c1925854-e508-4ef5-9dc7-aa17bffbe0cd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:01.657919 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-01a7ff4a-9000-4a79-b626-21ba1492ae4a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:01.658583 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-01a7ff4a-9000-4a79-b626-21ba1492ae4a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:01.664223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c1925854-e508-4ef5-9dc7-aa17bffbe0cd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:01.664971 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-01a7ff4a-9000-4a79-b626-21ba1492ae4a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.665371 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-01a7ff4a-9000-4a79-b626-21ba1492ae4a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:01.666141 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-01a7ff4a-9000-4a79-b626-21ba1492ae4a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.666798 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-01a7ff4a-9000-4a79-b626-21ba1492ae4a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:01.673074 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c1925854-e508-4ef5-9dc7-aa17bffbe0cd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:01.674926 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c1925854-e508-4ef5-9dc7-aa17bffbe0cd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:01.676110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c1925854-e508-4ef5-9dc7-aa17bffbe0cd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1332 microversion: 2.20 time: 0.126083 May 19 12:25:01.676686 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 55/110] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:01 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:01.744495 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-01a7ff4a-9000-4a79-b626-21ba1492ae4a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:01.756127 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-01a7ff4a-9000-4a79-b626-21ba1492ae4a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1294 microversion: 2.1 time: 0.103439 May 19 12:25:01.756728 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 56/111] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:01 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:01.953161 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-480b7ea6-96a6-450f-9b80-0bda770fe20c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:01.953772 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-480b7ea6-96a6-450f-9b80-0bda770fe20c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:01.960077 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-480b7ea6-96a6-450f-9b80-0bda770fe20c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.960530 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-480b7ea6-96a6-450f-9b80-0bda770fe20c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:01.961325 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-480b7ea6-96a6-450f-9b80-0bda770fe20c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:01.961766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-480b7ea6-96a6-450f-9b80-0bda770fe20c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:02.127513 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-480b7ea6-96a6-450f-9b80-0bda770fe20c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:02.135583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-480b7ea6-96a6-450f-9b80-0bda770fe20c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.186401 May 19 12:25:02.142488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 56/112] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:01 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:02.573566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dddbfd8c-8966-4d28-8616-4f5aaf3b4946 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:02.574341 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dddbfd8c-8966-4d28-8616-4f5aaf3b4946 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:02.576335 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:02.582461 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dddbfd8c-8966-4d28-8616-4f5aaf3b4946 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:02.582922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dddbfd8c-8966-4d28-8616-4f5aaf3b4946 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:02.583698 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dddbfd8c-8966-4d28-8616-4f5aaf3b4946 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:02.584140 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dddbfd8c-8966-4d28-8616-4f5aaf3b4946 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:02.609600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-dad6aa9c-c100-4efe-a46d-37d079f4a95a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:02.610209 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-dad6aa9c-c100-4efe-a46d-37d079f4a95a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:02.622182 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dad6aa9c-c100-4efe-a46d-37d079f4a95a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:02.622664 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dad6aa9c-c100-4efe-a46d-37d079f4a95a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:02.623439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dad6aa9c-c100-4efe-a46d-37d079f4a95a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:02.625587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dad6aa9c-c100-4efe-a46d-37d079f4a95a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:02.794376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dddbfd8c-8966-4d28-8616-4f5aaf3b4946 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:02.804537 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dddbfd8c-8966-4d28-8616-4f5aaf3b4946 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.235063 May 19 12:25:02.805284 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 57/113] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:02 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:02.810381 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ff6c338f-9e5d-4b10-934f-a9d19a919587 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:02.811012 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ff6c338f-9e5d-4b10-934f-a9d19a919587 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:02.818170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff6c338f-9e5d-4b10-934f-a9d19a919587 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:02.818685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff6c338f-9e5d-4b10-934f-a9d19a919587 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:02.819485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff6c338f-9e5d-4b10-934f-a9d19a919587 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:02.820089 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff6c338f-9e5d-4b10-934f-a9d19a919587 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:02.822210 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-dad6aa9c-c100-4efe-a46d-37d079f4a95a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:02.832694 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-dad6aa9c-c100-4efe-a46d-37d079f4a95a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.228160 May 19 12:25:02.833332 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 57/114] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:02 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:02.837942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-21dc8855-8f62-44eb-ab03-e9a81eeb5346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:02.838583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-21dc8855-8f62-44eb-ab03-e9a81eeb5346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:02.846733 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-21dc8855-8f62-44eb-ab03-e9a81eeb5346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:02.847186 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-21dc8855-8f62-44eb-ab03-e9a81eeb5346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:02.847985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-21dc8855-8f62-44eb-ab03-e9a81eeb5346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:02.848402 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-21dc8855-8f62-44eb-ab03-e9a81eeb5346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:02.890535 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ff6c338f-9e5d-4b10-934f-a9d19a919587 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:02.900272 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ff6c338f-9e5d-4b10-934f-a9d19a919587 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:02.902718 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ff6c338f-9e5d-4b10-934f-a9d19a919587 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:02.903194 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ff6c338f-9e5d-4b10-934f-a9d19a919587 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1332 microversion: 2.20 time: 0.096561 May 19 12:25:02.903765 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 58/115] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:02 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:02.924267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-21dc8855-8f62-44eb-ab03-e9a81eeb5346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:02.938614 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-21dc8855-8f62-44eb-ab03-e9a81eeb5346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1294 microversion: 2.1 time: 0.104175 May 19 12:25:02.939129 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 58/116] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:02 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:03.421717 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ea697359-08fa-45b6-b0b2-28b03d5105ba tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:03.421717 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ea697359-08fa-45b6-b0b2-28b03d5105ba tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:03.421717 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea697359-08fa-45b6-b0b2-28b03d5105ba tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:03.421717 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea697359-08fa-45b6-b0b2-28b03d5105ba tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:03.423598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea697359-08fa-45b6-b0b2-28b03d5105ba tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:03.423598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea697359-08fa-45b6-b0b2-28b03d5105ba tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:03.423598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ea697359-08fa-45b6-b0b2-28b03d5105ba tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:03.425640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ea697359-08fa-45b6-b0b2-28b03d5105ba tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.164293 May 19 12:25:03.425640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 59/117] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:03 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:03.822436 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-83ff76c3-fb80-42a5-8d9f-51632927b091 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:03.823421 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-83ff76c3-fb80-42a5-8d9f-51632927b091 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:03.829947 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-83ff76c3-fb80-42a5-8d9f-51632927b091 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:03.830429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-83ff76c3-fb80-42a5-8d9f-51632927b091 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:03.831185 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-83ff76c3-fb80-42a5-8d9f-51632927b091 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:03.831615 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-83ff76c3-fb80-42a5-8d9f-51632927b091 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:03.853638 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4d13b715-50a2-4fe0-a0f8-c38a0702874b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:03.854354 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4d13b715-50a2-4fe0-a0f8-c38a0702874b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:03.868050 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d13b715-50a2-4fe0-a0f8-c38a0702874b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:03.870900 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d13b715-50a2-4fe0-a0f8-c38a0702874b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:03.871800 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d13b715-50a2-4fe0-a0f8-c38a0702874b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:03.872321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d13b715-50a2-4fe0-a0f8-c38a0702874b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:04.035791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-83ff76c3-fb80-42a5-8d9f-51632927b091 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:04.045193 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-83ff76c3-fb80-42a5-8d9f-51632927b091 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.227128 May 19 12:25:04.047405 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 59/118] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:03 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:04.061725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4d13b715-50a2-4fe0-a0f8-c38a0702874b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:04.071522 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4d13b715-50a2-4fe0-a0f8-c38a0702874b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.222483 May 19 12:25:04.072359 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 60/119] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:03 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:04.079652 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f1f4c23d-cb81-45f7-912b-78c8348586b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:04.080290 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f1f4c23d-cb81-45f7-912b-78c8348586b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:04.087206 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f1f4c23d-cb81-45f7-912b-78c8348586b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:04.087665 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f1f4c23d-cb81-45f7-912b-78c8348586b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:04.088457 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f1f4c23d-cb81-45f7-912b-78c8348586b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:04.088900 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f1f4c23d-cb81-45f7-912b-78c8348586b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:04.128887 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-5fbdaf4c-ee4c-4bb3-8dd4-5f5b0f24b373 req-34ab73d7-9e26-41f8-a210-d3e7d9753ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fc59e9-f88a-46c9-a0d8-c695f778541e", "name": "network-vif-plugged", "status": "completed", "tag": "82ec4d27-e4be-404b-a6d9-8404077c5070"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:04.137874 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-5fbdaf4c-ee4c-4bb3-8dd4-5f5b0f24b373 req-34ab73d7-9e26-41f8-a210-d3e7d9753ae5 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:04.150464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-5fbdaf4c-ee4c-4bb3-8dd4-5f5b0f24b373 req-34ab73d7-9e26-41f8-a210-d3e7d9753ae5 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:04.150464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:04.151850 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-5fbdaf4c-ee4c-4bb3-8dd4-5f5b0f24b373 req-34ab73d7-9e26-41f8-a210-d3e7d9753ae5 service nova] Creating event network-vif-plugged:82ec4d27-e4be-404b-a6d9-8404077c5070 for instance 29fc59e9-f88a-46c9-a0d8-c695f778541e on hv-cinder-77819 May 19 12:25:04.155769 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f1f4c23d-cb81-45f7-912b-78c8348586b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:04.159690 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-5fbdaf4c-ee4c-4bb3-8dd4-5f5b0f24b373 req-34ab73d7-9e26-41f8-a210-d3e7d9753ae5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099865 May 19 12:25:04.160726 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 60/120] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:04.165266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f1f4c23d-cb81-45f7-912b-78c8348586b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:04.166947 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f1f4c23d-cb81-45f7-912b-78c8348586b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:04.168141 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f1f4c23d-cb81-45f7-912b-78c8348586b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1332 microversion: 2.20 time: 0.094538 May 19 12:25:04.178140 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 61/121] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:04 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:04.178554 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-cdba46dd-74dc-473f-9d77-e1a3460d17ce tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:04.178554 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-cdba46dd-74dc-473f-9d77-e1a3460d17ce tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:04.191135 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-cdba46dd-74dc-473f-9d77-e1a3460d17ce tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:04.198974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-cdba46dd-74dc-473f-9d77-e1a3460d17ce tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:04.198974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-cdba46dd-74dc-473f-9d77-e1a3460d17ce tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:04.198974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-cdba46dd-74dc-473f-9d77-e1a3460d17ce tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:04.269396 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-cdba46dd-74dc-473f-9d77-e1a3460d17ce tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:04.277896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-cdba46dd-74dc-473f-9d77-e1a3460d17ce tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1294 microversion: 2.1 time: 0.115465 May 19 12:25:04.278633 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 61/122] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:04 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1294 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:04.333175 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5c48f9a9-7d2d-4de9-bb32-60c70f83f1b0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:04.333791 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5c48f9a9-7d2d-4de9-bb32-60c70f83f1b0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:04.340426 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c48f9a9-7d2d-4de9-bb32-60c70f83f1b0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:04.340894 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c48f9a9-7d2d-4de9-bb32-60c70f83f1b0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:04.341654 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c48f9a9-7d2d-4de9-bb32-60c70f83f1b0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:04.342135 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c48f9a9-7d2d-4de9-bb32-60c70f83f1b0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:04.483512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5c48f9a9-7d2d-4de9-bb32-60c70f83f1b0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:04.491162 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5c48f9a9-7d2d-4de9-bb32-60c70f83f1b0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.161965 May 19 12:25:04.491770 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 62/123] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:04 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:05.065593 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-83f48a80-5d9c-4753-97fe-7f77b3059e94 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:05.066193 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-83f48a80-5d9c-4753-97fe-7f77b3059e94 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:05.072344 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-83f48a80-5d9c-4753-97fe-7f77b3059e94 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.072784 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-83f48a80-5d9c-4753-97fe-7f77b3059e94 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.073564 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-83f48a80-5d9c-4753-97fe-7f77b3059e94 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.073991 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-83f48a80-5d9c-4753-97fe-7f77b3059e94 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.090071 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a943702e-0e79-426d-aa50-a40053479150 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:05.090706 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a943702e-0e79-426d-aa50-a40053479150 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:05.097380 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a943702e-0e79-426d-aa50-a40053479150 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.098039 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a943702e-0e79-426d-aa50-a40053479150 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.098789 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a943702e-0e79-426d-aa50-a40053479150 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.099241 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a943702e-0e79-426d-aa50-a40053479150 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.286671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-83f48a80-5d9c-4753-97fe-7f77b3059e94 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:05.290655 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a943702e-0e79-426d-aa50-a40053479150 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:05.295171 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-83f48a80-5d9c-4753-97fe-7f77b3059e94 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.233823 May 19 12:25:05.296394 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 62/124] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:05 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:05.301892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5edfd72d-f805-4caf-8a3f-aa3c22dc651a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:05.303884 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5edfd72d-f805-4caf-8a3f-aa3c22dc651a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:05.309198 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5edfd72d-f805-4caf-8a3f-aa3c22dc651a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.309798 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5edfd72d-f805-4caf-8a3f-aa3c22dc651a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.310591 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5edfd72d-f805-4caf-8a3f-aa3c22dc651a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.311021 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5edfd72d-f805-4caf-8a3f-aa3c22dc651a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.311543 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a943702e-0e79-426d-aa50-a40053479150 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.225680 May 19 12:25:05.312151 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 63/125] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:05 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:05.318040 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1fb2fed1-be03-460a-9607-46ab7d953e75 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:05.333866 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1fb2fed1-be03-460a-9607-46ab7d953e75 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:05.337595 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1fb2fed1-be03-460a-9607-46ab7d953e75 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.338048 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1fb2fed1-be03-460a-9607-46ab7d953e75 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.338859 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1fb2fed1-be03-460a-9607-46ab7d953e75 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.339300 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1fb2fed1-be03-460a-9607-46ab7d953e75 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.357938 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:05.394606 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5edfd72d-f805-4caf-8a3f-aa3c22dc651a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:05.404021 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5edfd72d-f805-4caf-8a3f-aa3c22dc651a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:05.406546 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5edfd72d-f805-4caf-8a3f-aa3c22dc651a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:05.408244 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5edfd72d-f805-4caf-8a3f-aa3c22dc651a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1332 microversion: 2.20 time: 0.110284 May 19 12:25:05.414352 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 63/126] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:05 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:05.417033 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1fb2fed1-be03-460a-9607-46ab7d953e75 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:05.426253 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1fb2fed1-be03-460a-9607-46ab7d953e75 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1294 microversion: 2.1 time: 0.113099 May 19 12:25:05.426892 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 64/127] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:05 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1294 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:05.509414 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a4fdd932-c214-4f51-bc99-36d28acc00da tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:05.510072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a4fdd932-c214-4f51-bc99-36d28acc00da tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:05.512280 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:05.517797 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a4fdd932-c214-4f51-bc99-36d28acc00da tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.517797 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a4fdd932-c214-4f51-bc99-36d28acc00da tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.519172 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a4fdd932-c214-4f51-bc99-36d28acc00da tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:05.519608 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a4fdd932-c214-4f51-bc99-36d28acc00da tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:05.777203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a4fdd932-c214-4f51-bc99-36d28acc00da tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:05.786489 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a4fdd932-c214-4f51-bc99-36d28acc00da tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.280956 May 19 12:25:05.787956 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 64/128] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:05 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:06.229469 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-491ba240-baca-48c1-aa9f-370f74b25597 req-e0443b40-1f76-432e-ac79-ee241513d965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1", "name": "network-vif-plugged", "status": "completed", "tag": "b53cc247-1a43-4485-97e1-5c39672f1e3a"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:06.246572 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-491ba240-baca-48c1-aa9f-370f74b25597 req-e0443b40-1f76-432e-ac79-ee241513d965 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.247427 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-491ba240-baca-48c1-aa9f-370f74b25597 req-e0443b40-1f76-432e-ac79-ee241513d965 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.289501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-491ba240-baca-48c1-aa9f-370f74b25597 req-e0443b40-1f76-432e-ac79-ee241513d965 service nova] Creating event network-vif-plugged:b53cc247-1a43-4485-97e1-5c39672f1e3a for instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 on hv-cinder-77819 May 19 12:25:06.301859 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-491ba240-baca-48c1-aa9f-370f74b25597 req-e0443b40-1f76-432e-ac79-ee241513d965 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077785 May 19 12:25:06.302963 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 65/129] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:06.315978 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-296772e3-c122-4c38-bab1-b26176a07479 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:06.317128 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-296772e3-c122-4c38-bab1-b26176a07479 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:06.327966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-296772e3-c122-4c38-bab1-b26176a07479 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.330433 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-296772e3-c122-4c38-bab1-b26176a07479 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.334756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-296772e3-c122-4c38-bab1-b26176a07479 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.334756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-296772e3-c122-4c38-bab1-b26176a07479 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.354661 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e7691f7b-30f8-4aaf-bd04-fcd459df555b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:06.355422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e7691f7b-30f8-4aaf-bd04-fcd459df555b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:06.386864 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e7691f7b-30f8-4aaf-bd04-fcd459df555b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.387707 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e7691f7b-30f8-4aaf-bd04-fcd459df555b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.388831 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e7691f7b-30f8-4aaf-bd04-fcd459df555b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.389618 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e7691f7b-30f8-4aaf-bd04-fcd459df555b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.799367 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-296772e3-c122-4c38-bab1-b26176a07479 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:06.801199 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e7691f7b-30f8-4aaf-bd04-fcd459df555b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:06.807064 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-296772e3-c122-4c38-bab1-b26176a07479 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.495556 May 19 12:25:06.807821 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 65/130] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:06 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:06.817294 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e7691f7b-30f8-4aaf-bd04-fcd459df555b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.482856 May 19 12:25:06.817294 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 66/131] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:06 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:06.817294 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-574c0625-bbdc-4d6a-a445-33852bd8619f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:06.817294 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-574c0625-bbdc-4d6a-a445-33852bd8619f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:06.820723 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-574c0625-bbdc-4d6a-a445-33852bd8619f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.821169 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-574c0625-bbdc-4d6a-a445-33852bd8619f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.821944 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-574c0625-bbdc-4d6a-a445-33852bd8619f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.822486 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-574c0625-bbdc-4d6a-a445-33852bd8619f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.823190 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-dee78883-2654-4bcf-904e-439e8d9e27c1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:06.823800 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-dee78883-2654-4bcf-904e-439e8d9e27c1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:06.831069 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dee78883-2654-4bcf-904e-439e8d9e27c1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.831744 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dee78883-2654-4bcf-904e-439e8d9e27c1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.835768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dee78883-2654-4bcf-904e-439e8d9e27c1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.835768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dee78883-2654-4bcf-904e-439e8d9e27c1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.947374 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-574c0625-bbdc-4d6a-a445-33852bd8619f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:06.947759 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-dee78883-2654-4bcf-904e-439e8d9e27c1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:06.957918 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-574c0625-bbdc-4d6a-a445-33852bd8619f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:06.959584 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-574c0625-bbdc-4d6a-a445-33852bd8619f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:06.960197 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-dee78883-2654-4bcf-904e-439e8d9e27c1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1300 microversion: 2.1 time: 0.140364 May 19 12:25:06.960879 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-574c0625-bbdc-4d6a-a445-33852bd8619f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1338 microversion: 2.20 time: 0.150391 May 19 12:25:06.961143 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 66/132] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:06 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1300 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:06.961575 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 67/133] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:06 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1338 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:06.972805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-558ff123-8d35-4fec-a168-0249be29bfc5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:06.973566 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-558ff123-8d35-4fec-a168-0249be29bfc5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:06.980378 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-558ff123-8d35-4fec-a168-0249be29bfc5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.980821 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-558ff123-8d35-4fec-a168-0249be29bfc5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:06.981591 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-558ff123-8d35-4fec-a168-0249be29bfc5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:06.982180 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-558ff123-8d35-4fec-a168-0249be29bfc5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:07.143762 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-558ff123-8d35-4fec-a168-0249be29bfc5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:07.151830 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-558ff123-8d35-4fec-a168-0249be29bfc5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.189163 May 19 12:25:07.154384 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 67/134] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:06 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:07.824292 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e2f3e2dd-69e7-4ff8-a3f9-b88835fdf0c6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:07.824885 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6588c171-478e-4df5-8299-dfa95ff9103d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:07.825331 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e2f3e2dd-69e7-4ff8-a3f9-b88835fdf0c6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:07.826665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6588c171-478e-4df5-8299-dfa95ff9103d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:07.827782 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:07.832924 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e2f3e2dd-69e7-4ff8-a3f9-b88835fdf0c6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:07.833751 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e2f3e2dd-69e7-4ff8-a3f9-b88835fdf0c6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:07.833970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6588c171-478e-4df5-8299-dfa95ff9103d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:07.834107 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6588c171-478e-4df5-8299-dfa95ff9103d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:07.834266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e2f3e2dd-69e7-4ff8-a3f9-b88835fdf0c6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:07.834749 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e2f3e2dd-69e7-4ff8-a3f9-b88835fdf0c6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:07.835380 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6588c171-478e-4df5-8299-dfa95ff9103d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:07.835830 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6588c171-478e-4df5-8299-dfa95ff9103d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:08.029505 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e2f3e2dd-69e7-4ff8-a3f9-b88835fdf0c6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:08.038710 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e2f3e2dd-69e7-4ff8-a3f9-b88835fdf0c6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.217978 May 19 12:25:08.039382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 68/135] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:07 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:08.041577 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6588c171-478e-4df5-8299-dfa95ff9103d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:08.044481 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1f7ed2ac-ab33-40c5-8d4b-c6a6c12167f2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:08.045205 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1f7ed2ac-ab33-40c5-8d4b-c6a6c12167f2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:08.052181 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f7ed2ac-ab33-40c5-8d4b-c6a6c12167f2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:08.052733 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f7ed2ac-ab33-40c5-8d4b-c6a6c12167f2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:08.052904 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6588c171-478e-4df5-8299-dfa95ff9103d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.231662 May 19 12:25:08.062390 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 68/136] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:07 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:08.068596 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f7ed2ac-ab33-40c5-8d4b-c6a6c12167f2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:08.068596 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f7ed2ac-ab33-40c5-8d4b-c6a6c12167f2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:08.068816 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-075411e8-9d00-4759-804f-bcbf1e6f97d3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:08.068816 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-075411e8-9d00-4759-804f-bcbf1e6f97d3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:08.068816 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-075411e8-9d00-4759-804f-bcbf1e6f97d3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:08.068816 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-075411e8-9d00-4759-804f-bcbf1e6f97d3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:08.069078 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-075411e8-9d00-4759-804f-bcbf1e6f97d3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:08.069078 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-075411e8-9d00-4759-804f-bcbf1e6f97d3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:08.159099 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-075411e8-9d00-4759-804f-bcbf1e6f97d3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:08.168228 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-075411e8-9d00-4759-804f-bcbf1e6f97d3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:08.169838 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-075411e8-9d00-4759-804f-bcbf1e6f97d3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:08.171274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-075411e8-9d00-4759-804f-bcbf1e6f97d3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1338 microversion: 2.20 time: 0.116598 May 19 12:25:08.178978 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 69/137] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:08 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1338 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:08.189101 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1f3acfaa-38f1-41d6-839b-747f9e366795 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:08.189879 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1f3acfaa-38f1-41d6-839b-747f9e366795 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:08.208444 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1f3acfaa-38f1-41d6-839b-747f9e366795 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:08.209189 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1f3acfaa-38f1-41d6-839b-747f9e366795 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:08.209956 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1f3acfaa-38f1-41d6-839b-747f9e366795 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:08.210392 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1f3acfaa-38f1-41d6-839b-747f9e366795 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:08.240520 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1f7ed2ac-ab33-40c5-8d4b-c6a6c12167f2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:08.248126 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1f7ed2ac-ab33-40c5-8d4b-c6a6c12167f2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.207459 May 19 12:25:08.249234 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 69/138] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:08 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:08.344403 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1f3acfaa-38f1-41d6-839b-747f9e366795 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:08.351980 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1f3acfaa-38f1-41d6-839b-747f9e366795 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.178560 May 19 12:25:08.352632 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 70/139] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:08 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:09.057506 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b5b67f77-3196-4ea0-9373-1f7bd8a93ca4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:09.058113 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b5b67f77-3196-4ea0-9373-1f7bd8a93ca4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:09.064783 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b5b67f77-3196-4ea0-9373-1f7bd8a93ca4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.065239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b5b67f77-3196-4ea0-9373-1f7bd8a93ca4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.066735 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b5b67f77-3196-4ea0-9373-1f7bd8a93ca4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.066735 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b5b67f77-3196-4ea0-9373-1f7bd8a93ca4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.069469 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-eb49e63b-3fd2-455b-baba-93b483e9f9d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:09.070100 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-eb49e63b-3fd2-455b-baba-93b483e9f9d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:09.076488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-eb49e63b-3fd2-455b-baba-93b483e9f9d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.076961 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-eb49e63b-3fd2-455b-baba-93b483e9f9d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.077725 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-eb49e63b-3fd2-455b-baba-93b483e9f9d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.078228 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-eb49e63b-3fd2-455b-baba-93b483e9f9d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.279257 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b5b67f77-3196-4ea0-9373-1f7bd8a93ca4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:09.279778 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-eb49e63b-3fd2-455b-baba-93b483e9f9d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:09.285248 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b5b67f77-3196-4ea0-9373-1f7bd8a93ca4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.231852 May 19 12:25:09.285823 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 70/140] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:09 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:09.287885 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-eb49e63b-3fd2-455b-baba-93b483e9f9d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.222109 May 19 12:25:09.288455 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 71/141] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:09 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:09.290616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-eebc2ce1-db17-4287-81b7-7d6ad5681c0b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:09.291355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-eebc2ce1-db17-4287-81b7-7d6ad5681c0b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:09.293364 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9993a382-93c8-41c4-a590-40cc4b40ae6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:09.294123 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9993a382-93c8-41c4-a590-40cc4b40ae6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:09.298686 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eebc2ce1-db17-4287-81b7-7d6ad5681c0b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.299402 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eebc2ce1-db17-4287-81b7-7d6ad5681c0b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.300169 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eebc2ce1-db17-4287-81b7-7d6ad5681c0b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.300602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eebc2ce1-db17-4287-81b7-7d6ad5681c0b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.301073 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9993a382-93c8-41c4-a590-40cc4b40ae6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.301687 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9993a382-93c8-41c4-a590-40cc4b40ae6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.302487 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9993a382-93c8-41c4-a590-40cc4b40ae6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.302926 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9993a382-93c8-41c4-a590-40cc4b40ae6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.370205 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-eebc2ce1-db17-4287-81b7-7d6ad5681c0b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:09.378632 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-eebc2ce1-db17-4287-81b7-7d6ad5681c0b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:09.380148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-eebc2ce1-db17-4287-81b7-7d6ad5681c0b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:09.381282 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-eebc2ce1-db17-4287-81b7-7d6ad5681c0b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1338 microversion: 2.20 time: 0.094338 May 19 12:25:09.381850 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 71/142] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:09 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1338 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:09.386343 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d849efe9-f4c3-44f5-9f85-cd225601f695 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:09.386853 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d849efe9-f4c3-44f5-9f85-cd225601f695 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:09.393704 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d849efe9-f4c3-44f5-9f85-cd225601f695 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.396954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d849efe9-f4c3-44f5-9f85-cd225601f695 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.396954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d849efe9-f4c3-44f5-9f85-cd225601f695 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:09.396954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d849efe9-f4c3-44f5-9f85-cd225601f695 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:09.506153 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9993a382-93c8-41c4-a590-40cc4b40ae6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:09.513736 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9993a382-93c8-41c4-a590-40cc4b40ae6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.224149 May 19 12:25:09.514916 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 72/143] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:09 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:09.550711 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d849efe9-f4c3-44f5-9f85-cd225601f695 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:09.558209 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d849efe9-f4c3-44f5-9f85-cd225601f695 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.175414 May 19 12:25:09.558809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 72/144] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:09 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:10.309965 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-86acd240-d44d-44d4-864f-98a030d8a887 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:10.310525 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-51c07fb8-a2f9-4884-a9b0-accc9f418741 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:10.310990 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-51c07fb8-a2f9-4884-a9b0-accc9f418741 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:10.311700 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-86acd240-d44d-44d4-864f-98a030d8a887 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:10.318480 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-86acd240-d44d-44d4-864f-98a030d8a887 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.319120 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-86acd240-d44d-44d4-864f-98a030d8a887 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.320318 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51c07fb8-a2f9-4884-a9b0-accc9f418741 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.320462 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-86acd240-d44d-44d4-864f-98a030d8a887 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.320771 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-86acd240-d44d-44d4-864f-98a030d8a887 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.322720 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51c07fb8-a2f9-4884-a9b0-accc9f418741 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.324715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51c07fb8-a2f9-4884-a9b0-accc9f418741 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.325150 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51c07fb8-a2f9-4884-a9b0-accc9f418741 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.616325 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-86acd240-d44d-44d4-864f-98a030d8a887 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:10.625174 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-86acd240-d44d-44d4-864f-98a030d8a887 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.323412 May 19 12:25:10.626124 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 73/145] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:10 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:10.631910 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-815a3e61-7559-4d8f-85d0-e8604853020d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:10.632737 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-815a3e61-7559-4d8f-85d0-e8604853020d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:10.640220 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-815a3e61-7559-4d8f-85d0-e8604853020d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.640767 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-815a3e61-7559-4d8f-85d0-e8604853020d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.641647 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-815a3e61-7559-4d8f-85d0-e8604853020d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.642235 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-815a3e61-7559-4d8f-85d0-e8604853020d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.645500 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-51c07fb8-a2f9-4884-a9b0-accc9f418741 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:10.656358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-51c07fb8-a2f9-4884-a9b0-accc9f418741 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.353437 May 19 12:25:10.666000 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 73/146] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:10 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:10.671760 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3355da0e-318b-4e31-87b2-00c92abe796f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:10.672714 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3355da0e-318b-4e31-87b2-00c92abe796f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:10.679627 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3355da0e-318b-4e31-87b2-00c92abe796f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.680305 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3355da0e-318b-4e31-87b2-00c92abe796f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.681089 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3355da0e-318b-4e31-87b2-00c92abe796f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.681525 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3355da0e-318b-4e31-87b2-00c92abe796f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.710032 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-815a3e61-7559-4d8f-85d0-e8604853020d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:10.719255 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-815a3e61-7559-4d8f-85d0-e8604853020d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:10.721152 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-815a3e61-7559-4d8f-85d0-e8604853020d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:10.722560 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-815a3e61-7559-4d8f-85d0-e8604853020d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1338 microversion: 2.20 time: 0.095267 May 19 12:25:10.723202 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 74/147] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:10 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1338 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:10.727935 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5f368755-ef27-4342-86d8-d35ee7c87285 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:10.728754 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5f368755-ef27-4342-86d8-d35ee7c87285 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:10.739537 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f368755-ef27-4342-86d8-d35ee7c87285 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.740475 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f368755-ef27-4342-86d8-d35ee7c87285 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.741822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f368755-ef27-4342-86d8-d35ee7c87285 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:10.742546 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f368755-ef27-4342-86d8-d35ee7c87285 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:10.972935 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3355da0e-318b-4e31-87b2-00c92abe796f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:10.974073 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5f368755-ef27-4342-86d8-d35ee7c87285 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:10.985303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5f368755-ef27-4342-86d8-d35ee7c87285 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.260810 May 19 12:25:10.986276 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 75/148] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:10 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:10.996207 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3355da0e-318b-4e31-87b2-00c92abe796f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.325480 May 19 12:25:10.996207 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 74/149] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:10 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:11.282904 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-190d0fd8-1feb-4cf1-be0d-7fae330fd784 req-1bd29b89-4718-42ce-ad79-71b93cced994 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b2145b-8dcb-4d81-af12-42d1494da298", "name": "network-vif-plugged", "status": "completed", "tag": "ead40d23-6a23-4073-ba08-29726edb0ac8"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:11.296699 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-190d0fd8-1feb-4cf1-be0d-7fae330fd784 req-1bd29b89-4718-42ce-ad79-71b93cced994 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:11.297665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-190d0fd8-1feb-4cf1-be0d-7fae330fd784 req-1bd29b89-4718-42ce-ad79-71b93cced994 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:11.315015 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-190d0fd8-1feb-4cf1-be0d-7fae330fd784 req-1bd29b89-4718-42ce-ad79-71b93cced994 service nova] Creating event network-vif-plugged:ead40d23-6a23-4073-ba08-29726edb0ac8 for instance d5b2145b-8dcb-4d81-af12-42d1494da298 on hv-cinder-77819 May 19 12:25:11.324007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-190d0fd8-1feb-4cf1-be0d-7fae330fd784 req-1bd29b89-4718-42ce-ad79-71b93cced994 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045848 May 19 12:25:11.325120 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 76/150] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:11.469681 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-22a04a6e-afa5-4e22-96f1-f14faf371604 req-931f2a2f-5596-40c3-bfb1-8830eef57a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba02619-c806-4c69-bef7-857d2fc19405", "tag": "6e55cf88-9446-44e0-ba62-600e8724a7ee"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:11.481406 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-22a04a6e-afa5-4e22-96f1-f14faf371604 req-931f2a2f-5596-40c3-bfb1-8830eef57a60 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:11.481854 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-22a04a6e-afa5-4e22-96f1-f14faf371604 req-931f2a2f-5596-40c3-bfb1-8830eef57a60 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:11.494498 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-22a04a6e-afa5-4e22-96f1-f14faf371604 req-931f2a2f-5596-40c3-bfb1-8830eef57a60 service nova] Creating event network-changed:6e55cf88-9446-44e0-ba62-600e8724a7ee for instance 0ba02619-c806-4c69-bef7-857d2fc19405 on hv-cinder-77819 May 19 12:25:11.501599 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-22a04a6e-afa5-4e22-96f1-f14faf371604 req-931f2a2f-5596-40c3-bfb1-8830eef57a60 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041120 May 19 12:25:11.502220 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 75/151] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:11.647231 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e82e389c-26e6-4b14-ba63-73ef85f2442d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:11.648271 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e82e389c-26e6-4b14-ba63-73ef85f2442d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:11.658683 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e82e389c-26e6-4b14-ba63-73ef85f2442d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:11.659125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e82e389c-26e6-4b14-ba63-73ef85f2442d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:11.659906 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e82e389c-26e6-4b14-ba63-73ef85f2442d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:11.660454 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e82e389c-26e6-4b14-ba63-73ef85f2442d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:11.675499 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3416b82e-9203-4b7b-a317-02327ed24c8a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:11.679769 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3416b82e-9203-4b7b-a317-02327ed24c8a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:11.683798 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3416b82e-9203-4b7b-a317-02327ed24c8a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:11.684473 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3416b82e-9203-4b7b-a317-02327ed24c8a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:11.687944 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3416b82e-9203-4b7b-a317-02327ed24c8a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:11.687944 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3416b82e-9203-4b7b-a317-02327ed24c8a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:11.890607 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e82e389c-26e6-4b14-ba63-73ef85f2442d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:11.899598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e82e389c-26e6-4b14-ba63-73ef85f2442d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.260266 May 19 12:25:11.900202 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 77/152] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:11 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:11.905524 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c719a937-6873-4e13-b90b-8cae43a9fd20 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:11.906212 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c719a937-6873-4e13-b90b-8cae43a9fd20 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:11.912809 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c719a937-6873-4e13-b90b-8cae43a9fd20 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:11.913166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c719a937-6873-4e13-b90b-8cae43a9fd20 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:11.921262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3416b82e-9203-4b7b-a317-02327ed24c8a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:11.921579 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c719a937-6873-4e13-b90b-8cae43a9fd20 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:11.921579 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c719a937-6873-4e13-b90b-8cae43a9fd20 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:11.921579 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:11.927494 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3416b82e-9203-4b7b-a317-02327ed24c8a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.257293 May 19 12:25:11.928122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 76/153] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:11 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:12.003647 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a7c28b98-0d40-4bd9-ac1a-ed7848e9a080 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:12.004522 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a7c28b98-0d40-4bd9-ac1a-ed7848e9a080 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:12.011406 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a7c28b98-0d40-4bd9-ac1a-ed7848e9a080 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:12.011849 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a7c28b98-0d40-4bd9-ac1a-ed7848e9a080 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:12.012794 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a7c28b98-0d40-4bd9-ac1a-ed7848e9a080 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:12.013227 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a7c28b98-0d40-4bd9-ac1a-ed7848e9a080 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:12.051880 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c719a937-6873-4e13-b90b-8cae43a9fd20 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:12.061047 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c719a937-6873-4e13-b90b-8cae43a9fd20 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:12.063344 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c719a937-6873-4e13-b90b-8cae43a9fd20 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:12.064470 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c719a937-6873-4e13-b90b-8cae43a9fd20 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.163337 May 19 12:25:12.065029 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 78/154] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:11 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:12.069550 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-29f65071-f280-4c6e-9122-7fd8535cf9b0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:12.070348 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-29f65071-f280-4c6e-9122-7fd8535cf9b0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:12.076589 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29f65071-f280-4c6e-9122-7fd8535cf9b0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:12.077668 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29f65071-f280-4c6e-9122-7fd8535cf9b0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:12.078786 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29f65071-f280-4c6e-9122-7fd8535cf9b0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:12.079225 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29f65071-f280-4c6e-9122-7fd8535cf9b0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:12.221239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a7c28b98-0d40-4bd9-ac1a-ed7848e9a080 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:12.228776 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a7c28b98-0d40-4bd9-ac1a-ed7848e9a080 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.229880 May 19 12:25:12.229413 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 77/155] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:11 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:12.255591 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-29f65071-f280-4c6e-9122-7fd8535cf9b0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:12.263549 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-29f65071-f280-4c6e-9122-7fd8535cf9b0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.197418 May 19 12:25:12.264126 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 79/156] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:12 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:12.920153 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f365ff09-d9ac-4509-9242-5f8728da2f64 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:12.921528 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f365ff09-d9ac-4509-9242-5f8728da2f64 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:12.928455 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f365ff09-d9ac-4509-9242-5f8728da2f64 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:12.928954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f365ff09-d9ac-4509-9242-5f8728da2f64 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:12.929753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f365ff09-d9ac-4509-9242-5f8728da2f64 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:12.930185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f365ff09-d9ac-4509-9242-5f8728da2f64 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:12.945223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b0aaaf1a-7fc2-427c-b2e5-5bb4836cd597 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:12.946246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b0aaaf1a-7fc2-427c-b2e5-5bb4836cd597 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:12.953762 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b0aaaf1a-7fc2-427c-b2e5-5bb4836cd597 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:12.954197 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b0aaaf1a-7fc2-427c-b2e5-5bb4836cd597 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:12.955123 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b0aaaf1a-7fc2-427c-b2e5-5bb4836cd597 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:12.955488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b0aaaf1a-7fc2-427c-b2e5-5bb4836cd597 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:13.144929 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f365ff09-d9ac-4509-9242-5f8728da2f64 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:13.150474 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b0aaaf1a-7fc2-427c-b2e5-5bb4836cd597 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:13.153456 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f365ff09-d9ac-4509-9242-5f8728da2f64 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.237096 May 19 12:25:13.154447 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 78/157] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:12 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:13.159701 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b0aaaf1a-7fc2-427c-b2e5-5bb4836cd597 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.218260 May 19 12:25:13.160406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 80/158] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:12 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:13.160549 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-77c5dbec-4cee-466a-a9b9-e54149372a4b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:13.161135 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-77c5dbec-4cee-466a-a9b9-e54149372a4b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:13.167693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77c5dbec-4cee-466a-a9b9-e54149372a4b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:13.168144 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77c5dbec-4cee-466a-a9b9-e54149372a4b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:13.169108 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77c5dbec-4cee-466a-a9b9-e54149372a4b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:13.169611 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77c5dbec-4cee-466a-a9b9-e54149372a4b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:13.246977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5b64b14e-d9c0-4d4e-b181-3b935578145c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:13.247493 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5b64b14e-d9c0-4d4e-b181-3b935578145c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:13.254515 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5b64b14e-d9c0-4d4e-b181-3b935578145c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:13.254873 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5b64b14e-d9c0-4d4e-b181-3b935578145c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:13.255649 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5b64b14e-d9c0-4d4e-b181-3b935578145c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:13.256707 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5b64b14e-d9c0-4d4e-b181-3b935578145c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:13.341390 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-77c5dbec-4cee-466a-a9b9-e54149372a4b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:13.350458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-77c5dbec-4cee-466a-a9b9-e54149372a4b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:13.352086 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-77c5dbec-4cee-466a-a9b9-e54149372a4b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:13.353137 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-77c5dbec-4cee-466a-a9b9-e54149372a4b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.196733 May 19 12:25:13.353708 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 79/159] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:13 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:13.359667 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-17c14424-ce53-491e-955c-be5cc3953a92 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:13.366595 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-17c14424-ce53-491e-955c-be5cc3953a92 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:13.366595 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17c14424-ce53-491e-955c-be5cc3953a92 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:13.366951 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17c14424-ce53-491e-955c-be5cc3953a92 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:13.367710 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17c14424-ce53-491e-955c-be5cc3953a92 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:13.368151 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17c14424-ce53-491e-955c-be5cc3953a92 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:13.427907 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5b64b14e-d9c0-4d4e-b181-3b935578145c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:13.435516 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5b64b14e-d9c0-4d4e-b181-3b935578145c tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.192471 May 19 12:25:13.436218 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 81/160] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:13 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:13.512483 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-17c14424-ce53-491e-955c-be5cc3953a92 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:13.520379 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-17c14424-ce53-491e-955c-be5cc3953a92 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.165696 May 19 12:25:13.520960 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 80/161] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:13 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:14.170685 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-773f438c-4d8c-49ee-9216-19c401499f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:14.171871 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-773f438c-4d8c-49ee-9216-19c401499f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:14.178441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-227a77f0-4c97-4b7d-8140-f7d33ffe2b28 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:14.179252 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-227a77f0-4c97-4b7d-8140-f7d33ffe2b28 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:14.179442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-773f438c-4d8c-49ee-9216-19c401499f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.179646 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-773f438c-4d8c-49ee-9216-19c401499f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.180562 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-773f438c-4d8c-49ee-9216-19c401499f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.181115 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-773f438c-4d8c-49ee-9216-19c401499f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.188244 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-227a77f0-4c97-4b7d-8140-f7d33ffe2b28 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.188244 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-227a77f0-4c97-4b7d-8140-f7d33ffe2b28 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.188670 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-227a77f0-4c97-4b7d-8140-f7d33ffe2b28 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.188859 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-227a77f0-4c97-4b7d-8140-f7d33ffe2b28 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.384600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-773f438c-4d8c-49ee-9216-19c401499f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:14.392345 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-227a77f0-4c97-4b7d-8140-f7d33ffe2b28 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:14.393281 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-773f438c-4d8c-49ee-9216-19c401499f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.226543 May 19 12:25:14.393875 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 82/162] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:14 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:14.398778 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-82381564-2a78-4a3f-a017-8ed1a0df135f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:14.399622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-82381564-2a78-4a3f-a017-8ed1a0df135f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:14.400259 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-227a77f0-4c97-4b7d-8140-f7d33ffe2b28 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.226503 May 19 12:25:14.401026 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 81/163] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:14 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:14.408184 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-82381564-2a78-4a3f-a017-8ed1a0df135f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.408641 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-82381564-2a78-4a3f-a017-8ed1a0df135f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.409733 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-82381564-2a78-4a3f-a017-8ed1a0df135f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.410485 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-82381564-2a78-4a3f-a017-8ed1a0df135f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.454345 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3a51dfa9-9f8b-474e-bea1-84bb8bf2d3b5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:14.455005 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3a51dfa9-9f8b-474e-bea1-84bb8bf2d3b5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:14.461306 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a51dfa9-9f8b-474e-bea1-84bb8bf2d3b5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.461754 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a51dfa9-9f8b-474e-bea1-84bb8bf2d3b5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.462565 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a51dfa9-9f8b-474e-bea1-84bb8bf2d3b5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.463006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3a51dfa9-9f8b-474e-bea1-84bb8bf2d3b5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.479811 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:14.627661 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-82381564-2a78-4a3f-a017-8ed1a0df135f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:14.641868 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-82381564-2a78-4a3f-a017-8ed1a0df135f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:14.645940 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-82381564-2a78-4a3f-a017-8ed1a0df135f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:14.647264 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-82381564-2a78-4a3f-a017-8ed1a0df135f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.252107 May 19 12:25:14.648327 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 83/164] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:14 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:14.659325 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3a51dfa9-9f8b-474e-bea1-84bb8bf2d3b5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:14.663841 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-040157c0-56af-4183-ac85-4f2da732a40d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:14.664447 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-040157c0-56af-4183-ac85-4f2da732a40d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:14.671899 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-040157c0-56af-4183-ac85-4f2da732a40d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.672503 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-040157c0-56af-4183-ac85-4f2da732a40d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.673335 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-040157c0-56af-4183-ac85-4f2da732a40d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:14.673781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-040157c0-56af-4183-ac85-4f2da732a40d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:14.683512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3a51dfa9-9f8b-474e-bea1-84bb8bf2d3b5 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.233655 May 19 12:25:14.684031 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 82/165] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:14 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:14.969867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-040157c0-56af-4183-ac85-4f2da732a40d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:14.975857 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-040157c0-56af-4183-ac85-4f2da732a40d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.315633 May 19 12:25:14.976484 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 84/166] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:14 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:15.417113 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7e84ac73-61f5-490a-98f7-2553935df98e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:15.417719 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7e84ac73-61f5-490a-98f7-2553935df98e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:15.419373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-775de90f-9cd7-4713-8e88-425d1e2ba695 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:15.419976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-775de90f-9cd7-4713-8e88-425d1e2ba695 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:15.424483 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7e84ac73-61f5-490a-98f7-2553935df98e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:15.424933 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7e84ac73-61f5-490a-98f7-2553935df98e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:15.425699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7e84ac73-61f5-490a-98f7-2553935df98e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:15.426143 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7e84ac73-61f5-490a-98f7-2553935df98e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:15.426248 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-775de90f-9cd7-4713-8e88-425d1e2ba695 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:15.426710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-775de90f-9cd7-4713-8e88-425d1e2ba695 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:15.427462 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-775de90f-9cd7-4713-8e88-425d1e2ba695 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:15.427895 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-775de90f-9cd7-4713-8e88-425d1e2ba695 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:15.629092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7e84ac73-61f5-490a-98f7-2553935df98e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:15.638825 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7e84ac73-61f5-490a-98f7-2553935df98e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.225347 May 19 12:25:15.639947 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 83/167] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:15 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:15.642337 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-775de90f-9cd7-4713-8e88-425d1e2ba695 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:15.650051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-775de90f-9cd7-4713-8e88-425d1e2ba695 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.234334 May 19 12:25:15.650660 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 85/168] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:15 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:15.666758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1fa1779c-53c3-4b2b-8167-c695c683ba31 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:15.675209 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1fa1779c-53c3-4b2b-8167-c695c683ba31 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:15.675209 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1fa1779c-53c3-4b2b-8167-c695c683ba31 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:15.675209 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1fa1779c-53c3-4b2b-8167-c695c683ba31 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:15.675680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1fa1779c-53c3-4b2b-8167-c695c683ba31 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:15.676119 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1fa1779c-53c3-4b2b-8167-c695c683ba31 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:15.705695 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-60196000-f0d4-4087-baea-9ebd08993cbd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:15.706724 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-60196000-f0d4-4087-baea-9ebd08993cbd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:15.730505 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-60196000-f0d4-4087-baea-9ebd08993cbd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:15.730505 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-60196000-f0d4-4087-baea-9ebd08993cbd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:15.730505 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-60196000-f0d4-4087-baea-9ebd08993cbd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:15.730505 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-60196000-f0d4-4087-baea-9ebd08993cbd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:15.893987 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1fa1779c-53c3-4b2b-8167-c695c683ba31 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:15.902180 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1fa1779c-53c3-4b2b-8167-c695c683ba31 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:15.903730 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1fa1779c-53c3-4b2b-8167-c695c683ba31 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:15.904969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1fa1779c-53c3-4b2b-8167-c695c683ba31 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.242178 May 19 12:25:15.905948 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 84/169] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:15 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:15.916385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-60196000-f0d4-4087-baea-9ebd08993cbd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:15.924372 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-60196000-f0d4-4087-baea-9ebd08993cbd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.225870 May 19 12:25:15.926383 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 86/170] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:15 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:15.995924 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-77e5e522-7d02-45f8-b608-c8bacc8fdabb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:15.995924 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-77e5e522-7d02-45f8-b608-c8bacc8fdabb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:16.005037 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77e5e522-7d02-45f8-b608-c8bacc8fdabb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:16.005780 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77e5e522-7d02-45f8-b608-c8bacc8fdabb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:16.006637 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77e5e522-7d02-45f8-b608-c8bacc8fdabb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:16.007081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77e5e522-7d02-45f8-b608-c8bacc8fdabb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:16.343693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-77e5e522-7d02-45f8-b608-c8bacc8fdabb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:16.351190 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-77e5e522-7d02-45f8-b608-c8bacc8fdabb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.361595 May 19 12:25:16.353376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 85/171] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:15 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:16.376728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-f4fb63e2-5da6-4e1b-8678-4888a2399015 req-dd6f4d0f-e547-425c-84c2-34263631c943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac0842f-dd21-479d-894c-1080f1531013", "tag": "2ce047fc-9ae8-4336-a545-1e048200c75a"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:16.388611 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-f4fb63e2-5da6-4e1b-8678-4888a2399015 req-dd6f4d0f-e547-425c-84c2-34263631c943 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:16.391895 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-f4fb63e2-5da6-4e1b-8678-4888a2399015 req-dd6f4d0f-e547-425c-84c2-34263631c943 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:16.412781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-f4fb63e2-5da6-4e1b-8678-4888a2399015 req-dd6f4d0f-e547-425c-84c2-34263631c943 service nova] Creating event network-changed:2ce047fc-9ae8-4336-a545-1e048200c75a for instance 1ac0842f-dd21-479d-894c-1080f1531013 on hv-cinder-77819 May 19 12:25:16.418487 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-f4fb63e2-5da6-4e1b-8678-4888a2399015 req-dd6f4d0f-e547-425c-84c2-34263631c943 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047397 May 19 12:25:16.419621 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 87/172] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:16.656560 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7a7f5e2e-f88c-4b1e-b210-4584cc7b3c4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:16.657126 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7a7f5e2e-f88c-4b1e-b210-4584cc7b3c4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:16.663935 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7a7f5e2e-f88c-4b1e-b210-4584cc7b3c4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:16.664377 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7a7f5e2e-f88c-4b1e-b210-4584cc7b3c4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:16.665138 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7a7f5e2e-f88c-4b1e-b210-4584cc7b3c4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:16.665568 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7a7f5e2e-f88c-4b1e-b210-4584cc7b3c4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:16.667787 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5f180ef9-0036-4d7f-b07a-7231a2014406 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:16.668518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5f180ef9-0036-4d7f-b07a-7231a2014406 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:16.675727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f180ef9-0036-4d7f-b07a-7231a2014406 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:16.676172 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f180ef9-0036-4d7f-b07a-7231a2014406 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:16.676943 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f180ef9-0036-4d7f-b07a-7231a2014406 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:16.677378 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f180ef9-0036-4d7f-b07a-7231a2014406 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:16.874523 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7a7f5e2e-f88c-4b1e-b210-4584cc7b3c4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:16.879985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5f180ef9-0036-4d7f-b07a-7231a2014406 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:16.887151 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7a7f5e2e-f88c-4b1e-b210-4584cc7b3c4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.233838 May 19 12:25:16.888380 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5f180ef9-0036-4d7f-b07a-7231a2014406 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.224519 May 19 12:25:16.889945 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 88/173] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:16 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:16.896112 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 86/174] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:16 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:16.923179 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e3cb26da-455c-42f6-ae90-f75900c34041 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:16.923848 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e3cb26da-455c-42f6-ae90-f75900c34041 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:16.930286 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e3cb26da-455c-42f6-ae90-f75900c34041 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:16.930769 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e3cb26da-455c-42f6-ae90-f75900c34041 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:16.931540 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e3cb26da-455c-42f6-ae90-f75900c34041 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:16.932039 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e3cb26da-455c-42f6-ae90-f75900c34041 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:16.941579 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-75216258-5b71-4448-a3cd-f2874de72ee1 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:16.942185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-75216258-5b71-4448-a3cd-f2874de72ee1 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:16.948302 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-75216258-5b71-4448-a3cd-f2874de72ee1 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:16.948743 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-75216258-5b71-4448-a3cd-f2874de72ee1 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:16.949508 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-75216258-5b71-4448-a3cd-f2874de72ee1 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:16.949940 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-75216258-5b71-4448-a3cd-f2874de72ee1 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:17.143700 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e3cb26da-455c-42f6-ae90-f75900c34041 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:17.151750 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e3cb26da-455c-42f6-ae90-f75900c34041 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:17.155555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e3cb26da-455c-42f6-ae90-f75900c34041 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:17.155555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e3cb26da-455c-42f6-ae90-f75900c34041 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.235322 May 19 12:25:17.156119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 89/175] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:16 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:17.156706 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-75216258-5b71-4448-a3cd-f2874de72ee1 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:17.165536 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-75216258-5b71-4448-a3cd-f2874de72ee1 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.227960 May 19 12:25:17.166153 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 87/176] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:16 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:17.368659 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-dfb8c3bd-cc85-4c1a-8afd-a3053e5fbdc2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:17.369264 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-dfb8c3bd-cc85-4c1a-8afd-a3053e5fbdc2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:17.376136 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dfb8c3bd-cc85-4c1a-8afd-a3053e5fbdc2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:17.376581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dfb8c3bd-cc85-4c1a-8afd-a3053e5fbdc2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:17.377378 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dfb8c3bd-cc85-4c1a-8afd-a3053e5fbdc2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:17.377813 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dfb8c3bd-cc85-4c1a-8afd-a3053e5fbdc2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:17.525331 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-dfb8c3bd-cc85-4c1a-8afd-a3053e5fbdc2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:17.543418 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-dfb8c3bd-cc85-4c1a-8afd-a3053e5fbdc2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.168058 May 19 12:25:17.543418 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 90/177] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:17 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:17.912971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-57d7da90-28d4-4150-a4c2-82c2125899d4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:17.912971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-57d7da90-28d4-4150-a4c2-82c2125899d4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:17.914270 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a107c713-ac81-4e8c-ab2e-77e9a3ef20fd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:17.914927 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a107c713-ac81-4e8c-ab2e-77e9a3ef20fd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:17.917583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-57d7da90-28d4-4150-a4c2-82c2125899d4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:17.918022 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-57d7da90-28d4-4150-a4c2-82c2125899d4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:17.919063 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-57d7da90-28d4-4150-a4c2-82c2125899d4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:17.919638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-57d7da90-28d4-4150-a4c2-82c2125899d4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:17.923557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a107c713-ac81-4e8c-ab2e-77e9a3ef20fd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:17.924597 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a107c713-ac81-4e8c-ab2e-77e9a3ef20fd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:17.925979 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a107c713-ac81-4e8c-ab2e-77e9a3ef20fd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:17.926730 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a107c713-ac81-4e8c-ab2e-77e9a3ef20fd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:18.149180 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a107c713-ac81-4e8c-ab2e-77e9a3ef20fd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:18.150975 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-57d7da90-28d4-4150-a4c2-82c2125899d4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:18.162007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-57d7da90-28d4-4150-a4c2-82c2125899d4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.255234 May 19 12:25:18.162434 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a107c713-ac81-4e8c-ab2e-77e9a3ef20fd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.259761 May 19 12:25:18.162761 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 91/178] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:17 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:18.174449 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 88/179] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:17 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:18.181724 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ed889bf2-383a-4a3a-8e0c-bff53dc8c773 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:18.182941 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ed889bf2-383a-4a3a-8e0c-bff53dc8c773 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:18.186583 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-debac206-c0b5-4785-8e0b-a6b61d8c8508 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:18.188343 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-debac206-c0b5-4785-8e0b-a6b61d8c8508 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:18.191451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ed889bf2-383a-4a3a-8e0c-bff53dc8c773 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:18.193523 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ed889bf2-383a-4a3a-8e0c-bff53dc8c773 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:18.193523 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ed889bf2-383a-4a3a-8e0c-bff53dc8c773 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:18.193523 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ed889bf2-383a-4a3a-8e0c-bff53dc8c773 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:18.194637 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-debac206-c0b5-4785-8e0b-a6b61d8c8508 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:18.195090 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-debac206-c0b5-4785-8e0b-a6b61d8c8508 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:18.198219 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-debac206-c0b5-4785-8e0b-a6b61d8c8508 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:18.198928 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-debac206-c0b5-4785-8e0b-a6b61d8c8508 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:18.445722 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ed889bf2-383a-4a3a-8e0c-bff53dc8c773 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:18.455221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ed889bf2-383a-4a3a-8e0c-bff53dc8c773 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:18.456888 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ed889bf2-383a-4a3a-8e0c-bff53dc8c773 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:18.459349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ed889bf2-383a-4a3a-8e0c-bff53dc8c773 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.288694 May 19 12:25:18.460712 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 92/180] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:18 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:18.485292 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-debac206-c0b5-4785-8e0b-a6b61d8c8508 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:18.496913 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-debac206-c0b5-4785-8e0b-a6b61d8c8508 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.315993 May 19 12:25:18.505537 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 89/181] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:18 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:18.550878 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e1f1bc01-f63f-417f-903a-54c56831641e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:18.551723 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e1f1bc01-f63f-417f-903a-54c56831641e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:18.557785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e1f1bc01-f63f-417f-903a-54c56831641e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:18.558228 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e1f1bc01-f63f-417f-903a-54c56831641e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:18.559033 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e1f1bc01-f63f-417f-903a-54c56831641e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:18.559469 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e1f1bc01-f63f-417f-903a-54c56831641e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:18.700196 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e1f1bc01-f63f-417f-903a-54c56831641e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:18.707673 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e1f1bc01-f63f-417f-903a-54c56831641e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.162472 May 19 12:25:18.708242 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 93/182] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:18 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:19.180454 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9ea520c8-32eb-4c11-97d2-253e5e7de328 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:19.181048 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9ea520c8-32eb-4c11-97d2-253e5e7de328 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:19.183741 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-864f76e8-168b-4b69-bad5-f0b058735da0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:19.185645 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-864f76e8-168b-4b69-bad5-f0b058735da0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:19.187162 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9ea520c8-32eb-4c11-97d2-253e5e7de328 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.187713 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9ea520c8-32eb-4c11-97d2-253e5e7de328 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.188599 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9ea520c8-32eb-4c11-97d2-253e5e7de328 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.189083 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9ea520c8-32eb-4c11-97d2-253e5e7de328 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.191036 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-864f76e8-168b-4b69-bad5-f0b058735da0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.191487 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-864f76e8-168b-4b69-bad5-f0b058735da0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.192369 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-864f76e8-168b-4b69-bad5-f0b058735da0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.192799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-864f76e8-168b-4b69-bad5-f0b058735da0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.408557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9ea520c8-32eb-4c11-97d2-253e5e7de328 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:19.412202 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-864f76e8-168b-4b69-bad5-f0b058735da0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:19.419463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9ea520c8-32eb-4c11-97d2-253e5e7de328 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.242545 May 19 12:25:19.420813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 90/183] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:19 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:19.422937 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-864f76e8-168b-4b69-bad5-f0b058735da0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.242892 May 19 12:25:19.424298 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 94/184] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:19 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:19.479043 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7cfe5e4a-a1c1-4a2e-80af-71bb6ef177d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:19.481046 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7cfe5e4a-a1c1-4a2e-80af-71bb6ef177d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:19.490396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7cfe5e4a-a1c1-4a2e-80af-71bb6ef177d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.491228 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7cfe5e4a-a1c1-4a2e-80af-71bb6ef177d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.492436 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7cfe5e4a-a1c1-4a2e-80af-71bb6ef177d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.493046 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7cfe5e4a-a1c1-4a2e-80af-71bb6ef177d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.518922 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3643cbc9-0821-4963-8b50-a486ffd0f77e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:19.519846 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3643cbc9-0821-4963-8b50-a486ffd0f77e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:19.529789 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3643cbc9-0821-4963-8b50-a486ffd0f77e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.530223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3643cbc9-0821-4963-8b50-a486ffd0f77e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.531557 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3643cbc9-0821-4963-8b50-a486ffd0f77e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.532704 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3643cbc9-0821-4963-8b50-a486ffd0f77e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.573826 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:19.826925 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7cfe5e4a-a1c1-4a2e-80af-71bb6ef177d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:19.847472 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7cfe5e4a-a1c1-4a2e-80af-71bb6ef177d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:19.849489 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7cfe5e4a-a1c1-4a2e-80af-71bb6ef177d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:19.850748 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7cfe5e4a-a1c1-4a2e-80af-71bb6ef177d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.376731 May 19 12:25:19.851396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 91/185] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:19 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:19.868303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9df92552-6042-43da-a01d-037f1b1bef5d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:19.869161 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9df92552-6042-43da-a01d-037f1b1bef5d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:19.882084 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9df92552-6042-43da-a01d-037f1b1bef5d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.887242 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9df92552-6042-43da-a01d-037f1b1bef5d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.887242 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9df92552-6042-43da-a01d-037f1b1bef5d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:19.887242 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9df92552-6042-43da-a01d-037f1b1bef5d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:19.892644 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3643cbc9-0821-4963-8b50-a486ffd0f77e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:19.902920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3643cbc9-0821-4963-8b50-a486ffd0f77e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.389242 May 19 12:25:19.903388 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 95/186] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:19 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:20.074581 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9df92552-6042-43da-a01d-037f1b1bef5d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:20.085543 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9df92552-6042-43da-a01d-037f1b1bef5d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.221642 May 19 12:25:20.091913 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 92/187] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:19 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:20.437344 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c547ad32-d501-4f8c-ae38-1be2e246b686 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:20.438164 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c547ad32-d501-4f8c-ae38-1be2e246b686 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:20.441985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-73475e35-e9c6-423b-bceb-a09b4f7cca71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:20.442764 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-73475e35-e9c6-423b-bceb-a09b4f7cca71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:20.445304 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c547ad32-d501-4f8c-ae38-1be2e246b686 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:20.445943 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c547ad32-d501-4f8c-ae38-1be2e246b686 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:20.446957 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c547ad32-d501-4f8c-ae38-1be2e246b686 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:20.447558 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c547ad32-d501-4f8c-ae38-1be2e246b686 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:20.448899 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-73475e35-e9c6-423b-bceb-a09b4f7cca71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:20.449347 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-73475e35-e9c6-423b-bceb-a09b4f7cca71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:20.450118 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-73475e35-e9c6-423b-bceb-a09b4f7cca71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:20.450587 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-73475e35-e9c6-423b-bceb-a09b4f7cca71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:20.684446 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c547ad32-d501-4f8c-ae38-1be2e246b686 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:20.686859 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-73475e35-e9c6-423b-bceb-a09b4f7cca71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:20.700269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-73475e35-e9c6-423b-bceb-a09b4f7cca71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.262899 May 19 12:25:20.703694 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c547ad32-d501-4f8c-ae38-1be2e246b686 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1361 microversion: 2.1 time: 0.269070 May 19 12:25:20.705735 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 96/188] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:20 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:20.716039 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 93/189] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:20 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:20.875519 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2f95ee8a-52fb-44d7-a9bb-b37bda5b024e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:20.876422 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2f95ee8a-52fb-44d7-a9bb-b37bda5b024e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:20.893249 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f95ee8a-52fb-44d7-a9bb-b37bda5b024e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:20.893694 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f95ee8a-52fb-44d7-a9bb-b37bda5b024e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:20.894529 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f95ee8a-52fb-44d7-a9bb-b37bda5b024e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:20.894968 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f95ee8a-52fb-44d7-a9bb-b37bda5b024e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:20.924746 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ee9b2f2f-e2f1-4684-b7a1-a3e7b9959653 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:20.925372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ee9b2f2f-e2f1-4684-b7a1-a3e7b9959653 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:20.933994 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ee9b2f2f-e2f1-4684-b7a1-a3e7b9959653 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:20.934635 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ee9b2f2f-e2f1-4684-b7a1-a3e7b9959653 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:20.935581 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ee9b2f2f-e2f1-4684-b7a1-a3e7b9959653 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:20.936119 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ee9b2f2f-e2f1-4684-b7a1-a3e7b9959653 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:21.172859 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2f95ee8a-52fb-44d7-a9bb-b37bda5b024e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:21.182941 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2f95ee8a-52fb-44d7-a9bb-b37bda5b024e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:21.184732 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ee9b2f2f-e2f1-4684-b7a1-a3e7b9959653 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:21.185104 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2f95ee8a-52fb-44d7-a9bb-b37bda5b024e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:21.186373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2f95ee8a-52fb-44d7-a9bb-b37bda5b024e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.319334 May 19 12:25:21.187398 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 97/190] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:20 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:21.192313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fcbdd0fa-adbf-47f1-aaad-a565d1127c41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:21.193086 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fcbdd0fa-adbf-47f1-aaad-a565d1127c41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:21.200059 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fcbdd0fa-adbf-47f1-aaad-a565d1127c41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:21.200675 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fcbdd0fa-adbf-47f1-aaad-a565d1127c41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:21.201614 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fcbdd0fa-adbf-47f1-aaad-a565d1127c41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:21.203567 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fcbdd0fa-adbf-47f1-aaad-a565d1127c41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:21.203716 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ee9b2f2f-e2f1-4684-b7a1-a3e7b9959653 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1315 microversion: 2.1 time: 0.286204 May 19 12:25:21.203716 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 94/191] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:20 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:21.410365 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fcbdd0fa-adbf-47f1-aaad-a565d1127c41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:21.421098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fcbdd0fa-adbf-47f1-aaad-a565d1127c41 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.232493 May 19 12:25:21.422316 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 98/192] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:21 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:21.560018 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-5db5e47d-8a31-4be9-b318-d8f5e6bc38cf req-f37d4cf6-5ed6-4006-9ae9-6c6cb18636a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e6669b-4005-4691-9a9e-42cd9f209a44", "name": "network-vif-plugged", "status": "completed", "tag": "8d75d107-85c3-4858-8b90-5ba107a81513"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:21.570327 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-5db5e47d-8a31-4be9-b318-d8f5e6bc38cf req-f37d4cf6-5ed6-4006-9ae9-6c6cb18636a5 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:21.570968 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-5db5e47d-8a31-4be9-b318-d8f5e6bc38cf req-f37d4cf6-5ed6-4006-9ae9-6c6cb18636a5 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:21.728223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2f7c25bc-025b-496b-8b65-cb38d3cc650d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:21.731069 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2f7c25bc-025b-496b-8b65-cb38d3cc650d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:21.733013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-5db5e47d-8a31-4be9-b318-d8f5e6bc38cf req-f37d4cf6-5ed6-4006-9ae9-6c6cb18636a5 service nova] Creating event network-vif-plugged:8d75d107-85c3-4858-8b90-5ba107a81513 for instance 99e6669b-4005-4691-9a9e-42cd9f209a44 on hv-cinder-77819 May 19 12:25:21.746396 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f7c25bc-025b-496b-8b65-cb38d3cc650d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:21.747337 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f7c25bc-025b-496b-8b65-cb38d3cc650d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:21.748194 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-5db5e47d-8a31-4be9-b318-d8f5e6bc38cf req-f37d4cf6-5ed6-4006-9ae9-6c6cb18636a5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191559 May 19 12:25:21.748625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f7c25bc-025b-496b-8b65-cb38d3cc650d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:21.750659 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f7c25bc-025b-496b-8b65-cb38d3cc650d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:21.750979 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 95/193] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:21.764707 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8a8fb56b-3786-4cbb-a570-74c06c455ab8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:21.766602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8a8fb56b-3786-4cbb-a570-74c06c455ab8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:21.783420 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8a8fb56b-3786-4cbb-a570-74c06c455ab8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:21.786726 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8a8fb56b-3786-4cbb-a570-74c06c455ab8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:21.786726 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8a8fb56b-3786-4cbb-a570-74c06c455ab8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:21.786726 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8a8fb56b-3786-4cbb-a570-74c06c455ab8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.250534 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2f7c25bc-025b-496b-8b65-cb38d3cc650d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:22.253748 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8a8fb56b-3786-4cbb-a570-74c06c455ab8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:22.266692 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8a8fb56b-3786-4cbb-a570-74c06c455ab8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1546 microversion: 2.1 time: 0.513320 May 19 12:25:22.267406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2f7c25bc-025b-496b-8b65-cb38d3cc650d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.542907 May 19 12:25:22.267628 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 96/194] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:21 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1546 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:22.270578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 99/195] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:21 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:22.277841 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ce6dcb42-1ede-4665-8c32-90b1f6f6b369 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:22.282004 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ce6dcb42-1ede-4665-8c32-90b1f6f6b369 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:22.283510 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-219a5238-4c47-4f12-adb8-a9630c4819e4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:22.284664 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-219a5238-4c47-4f12-adb8-a9630c4819e4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:22.291044 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ce6dcb42-1ede-4665-8c32-90b1f6f6b369 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:22.291496 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ce6dcb42-1ede-4665-8c32-90b1f6f6b369 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.292342 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ce6dcb42-1ede-4665-8c32-90b1f6f6b369 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:22.292807 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ce6dcb42-1ede-4665-8c32-90b1f6f6b369 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.294473 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-219a5238-4c47-4f12-adb8-a9630c4819e4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:22.295194 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-219a5238-4c47-4f12-adb8-a9630c4819e4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.296226 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-219a5238-4c47-4f12-adb8-a9630c4819e4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:22.296921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-219a5238-4c47-4f12-adb8-a9630c4819e4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.521666 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ce6dcb42-1ede-4665-8c32-90b1f6f6b369 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:22.526907 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-219a5238-4c47-4f12-adb8-a9630c4819e4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:22.530155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ce6dcb42-1ede-4665-8c32-90b1f6f6b369 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1501 microversion: 2.1 time: 0.258261 May 19 12:25:22.531506 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 100/196] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:22 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1501 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:22.535713 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-219a5238-4c47-4f12-adb8-a9630c4819e4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:22.537227 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-219a5238-4c47-4f12-adb8-a9630c4819e4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:22.541601 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4d98d237-d30d-4bd8-aaa7-79985c0b6dc0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:22.541601 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4d98d237-d30d-4bd8-aaa7-79985c0b6dc0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:22.541808 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-219a5238-4c47-4f12-adb8-a9630c4819e4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.269819 May 19 12:25:22.541808 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 97/197] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:22 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:22.544051 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-76712f40-ea29-491c-b739-103addfe8419 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:22.544881 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-76712f40-ea29-491c-b739-103addfe8419 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:22.545580 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4d98d237-d30d-4bd8-aaa7-79985c0b6dc0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:22.548831 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4d98d237-d30d-4bd8-aaa7-79985c0b6dc0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.548831 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4d98d237-d30d-4bd8-aaa7-79985c0b6dc0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:22.549436 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4d98d237-d30d-4bd8-aaa7-79985c0b6dc0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.552329 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-76712f40-ea29-491c-b739-103addfe8419 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:22.552783 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-76712f40-ea29-491c-b739-103addfe8419 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.553601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-76712f40-ea29-491c-b739-103addfe8419 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:22.553991 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-76712f40-ea29-491c-b739-103addfe8419 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:22.883901 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4d98d237-d30d-4bd8-aaa7-79985c0b6dc0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.350199 May 19 12:25:22.885111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 101/198] 10.222.0.57 () {58 vars in 1274 bytes} [Thu May 19 12:25:22 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/os-interface => generated 284 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:22.942590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-76712f40-ea29-491c-b739-103addfe8419 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:22.954326 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-76712f40-ea29-491c-b739-103addfe8419 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.413166 May 19 12:25:22.955072 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 98/199] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:22 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:23.286782 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-784f08aa-6b14-4629-adad-3d2ea6e8971c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:23.287590 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-784f08aa-6b14-4629-adad-3d2ea6e8971c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:23.295602 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-784f08aa-6b14-4629-adad-3d2ea6e8971c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.296092 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-784f08aa-6b14-4629-adad-3d2ea6e8971c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:23.297981 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-784f08aa-6b14-4629-adad-3d2ea6e8971c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.298652 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-784f08aa-6b14-4629-adad-3d2ea6e8971c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:23.529313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-784f08aa-6b14-4629-adad-3d2ea6e8971c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:23.557326 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-784f08aa-6b14-4629-adad-3d2ea6e8971c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.276368 May 19 12:25:23.559500 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6d2188ea-9e01-4160-a080-1fd42cb6b268 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:23.560331 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6d2188ea-9e01-4160-a080-1fd42cb6b268 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:23.560859 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 102/200] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:23 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:23.579169 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6d2188ea-9e01-4160-a080-1fd42cb6b268 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.579657 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6d2188ea-9e01-4160-a080-1fd42cb6b268 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:23.584653 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6d2188ea-9e01-4160-a080-1fd42cb6b268 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.585117 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6d2188ea-9e01-4160-a080-1fd42cb6b268 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:23.795234 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6d2188ea-9e01-4160-a080-1fd42cb6b268 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:23.798380 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:23.807753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6d2188ea-9e01-4160-a080-1fd42cb6b268 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:23.810285 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6d2188ea-9e01-4160-a080-1fd42cb6b268 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:23.811720 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6d2188ea-9e01-4160-a080-1fd42cb6b268 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.256674 May 19 12:25:23.813271 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 99/201] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:23 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:25:23.972596 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-dc2cbcee-1011-4361-8334-bee3151cd5b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:23.973278 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-dc2cbcee-1011-4361-8334-bee3151cd5b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:23.980121 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dc2cbcee-1011-4361-8334-bee3151cd5b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.980788 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dc2cbcee-1011-4361-8334-bee3151cd5b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:23.981897 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dc2cbcee-1011-4361-8334-bee3151cd5b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:23.989742 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-dc2cbcee-1011-4361-8334-bee3151cd5b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:24.145267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-dc2cbcee-1011-4361-8334-bee3151cd5b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:24.157452 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-dc2cbcee-1011-4361-8334-bee3151cd5b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.188498 May 19 12:25:24.158090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 103/202] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:23 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:24.575853 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2f2f90c6-03da-4cf7-a988-c451f42ddad7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:24.577085 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2f2f90c6-03da-4cf7-a988-c451f42ddad7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:24.585319 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2f2f90c6-03da-4cf7-a988-c451f42ddad7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:24.585787 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2f2f90c6-03da-4cf7-a988-c451f42ddad7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:24.587070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2f2f90c6-03da-4cf7-a988-c451f42ddad7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:24.587695 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2f2f90c6-03da-4cf7-a988-c451f42ddad7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:24.739774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2f2f90c6-03da-4cf7-a988-c451f42ddad7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:24.748245 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2f2f90c6-03da-4cf7-a988-c451f42ddad7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.176112 May 19 12:25:24.748945 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 100/203] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:24 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:24.831517 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f068ffa8-fdef-4ad0-8065-91d539443034 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:24.832597 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f068ffa8-fdef-4ad0-8065-91d539443034 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:24.846565 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-f417a9df-1fac-480f-b6c9-757eaa607932 req-e36939d8-f901-4f01-90aa-27370f79c04f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1", "tag": "b53cc247-1a43-4485-97e1-5c39672f1e3a"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:24.847091 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f068ffa8-fdef-4ad0-8065-91d539443034 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:24.847805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f068ffa8-fdef-4ad0-8065-91d539443034 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:24.851028 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f068ffa8-fdef-4ad0-8065-91d539443034 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:24.853352 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f068ffa8-fdef-4ad0-8065-91d539443034 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:24.854808 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-f417a9df-1fac-480f-b6c9-757eaa607932 req-e36939d8-f901-4f01-90aa-27370f79c04f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:24.855236 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-f417a9df-1fac-480f-b6c9-757eaa607932 req-e36939d8-f901-4f01-90aa-27370f79c04f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:24.867982 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-f417a9df-1fac-480f-b6c9-757eaa607932 req-e36939d8-f901-4f01-90aa-27370f79c04f service nova] Creating event network-changed:b53cc247-1a43-4485-97e1-5c39672f1e3a for instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 on hv-cinder-77819 May 19 12:25:24.877276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-f417a9df-1fac-480f-b6c9-757eaa607932 req-e36939d8-f901-4f01-90aa-27370f79c04f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034306 May 19 12:25:24.878844 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 101/204] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:25:25.063402 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f068ffa8-fdef-4ad0-8065-91d539443034 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:25.071846 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f068ffa8-fdef-4ad0-8065-91d539443034 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:25.080039 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f068ffa8-fdef-4ad0-8065-91d539443034 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:25.080039 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f068ffa8-fdef-4ad0-8065-91d539443034 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.248311 May 19 12:25:25.080039 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 104/205] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:24 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:25.177039 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cc49787f-e64a-4d72-9893-80f2b40a1d08 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:25.178163 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cc49787f-e64a-4d72-9893-80f2b40a1d08 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:25.185457 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc49787f-e64a-4d72-9893-80f2b40a1d08 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:25.189172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc49787f-e64a-4d72-9893-80f2b40a1d08 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:25.190317 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc49787f-e64a-4d72-9893-80f2b40a1d08 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:25.190913 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc49787f-e64a-4d72-9893-80f2b40a1d08 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:25.618326 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cc49787f-e64a-4d72-9893-80f2b40a1d08 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:25.643139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cc49787f-e64a-4d72-9893-80f2b40a1d08 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.471948 May 19 12:25:25.643656 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 102/206] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:25 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:25.769079 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-447c1a91-8ade-4105-92b1-2c42c58ba770 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:25.770362 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-447c1a91-8ade-4105-92b1-2c42c58ba770 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:25.780195 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-447c1a91-8ade-4105-92b1-2c42c58ba770 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:25.780635 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-447c1a91-8ade-4105-92b1-2c42c58ba770 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:25.782401 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-447c1a91-8ade-4105-92b1-2c42c58ba770 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:25.788269 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-447c1a91-8ade-4105-92b1-2c42c58ba770 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:25.803689 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2e551e9e-4aa2-4e6c-b24b-5731c24b767e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef7a593b-52d7-49e6-96f0-e27b822595df"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:25.804794 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2e551e9e-4aa2-4e6c-b24b-5731c24b767e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:25.811129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2e551e9e-4aa2-4e6c-b24b-5731c24b767e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:25.811583 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2e551e9e-4aa2-4e6c-b24b-5731c24b767e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:25.813036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2e551e9e-4aa2-4e6c-b24b-5731c24b767e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:25.813643 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2e551e9e-4aa2-4e6c-b24b-5731c24b767e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:26.010128 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-447c1a91-8ade-4105-92b1-2c42c58ba770 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:26.034659 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-447c1a91-8ade-4105-92b1-2c42c58ba770 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.273077 May 19 12:25:26.039487 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 105/207] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:25 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:26.093382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f2fd1702-a0b8-4878-8334-09defb522805 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:26.093995 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f2fd1702-a0b8-4878-8334-09defb522805 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:26.100367 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f2fd1702-a0b8-4878-8334-09defb522805 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:26.100802 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f2fd1702-a0b8-4878-8334-09defb522805 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:26.101582 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f2fd1702-a0b8-4878-8334-09defb522805 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:26.102044 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f2fd1702-a0b8-4878-8334-09defb522805 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:26.261473 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f2fd1702-a0b8-4878-8334-09defb522805 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:26.270385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f2fd1702-a0b8-4878-8334-09defb522805 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:26.272359 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f2fd1702-a0b8-4878-8334-09defb522805 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:26.273530 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f2fd1702-a0b8-4878-8334-09defb522805 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.184178 May 19 12:25:26.284819 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 106/208] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:26 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:25:26.660685 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5e6231a4-76f0-4842-b240-38c380ba8a19 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:26.661294 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5e6231a4-76f0-4842-b240-38c380ba8a19 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:26.667414 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5e6231a4-76f0-4842-b240-38c380ba8a19 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:26.667855 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5e6231a4-76f0-4842-b240-38c380ba8a19 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:26.668728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5e6231a4-76f0-4842-b240-38c380ba8a19 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:26.669256 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5e6231a4-76f0-4842-b240-38c380ba8a19 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:26.851387 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5e6231a4-76f0-4842-b240-38c380ba8a19 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:26.859799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5e6231a4-76f0-4842-b240-38c380ba8a19 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.203101 May 19 12:25:26.860432 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 107/209] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:26 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:27.055541 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f8b6d541-83a7-44cd-9f44-823efc771717 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:27.056064 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f8b6d541-83a7-44cd-9f44-823efc771717 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:27.062149 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8b6d541-83a7-44cd-9f44-823efc771717 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:27.062737 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8b6d541-83a7-44cd-9f44-823efc771717 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:27.063517 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8b6d541-83a7-44cd-9f44-823efc771717 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:27.063957 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8b6d541-83a7-44cd-9f44-823efc771717 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:27.229287 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f8b6d541-83a7-44cd-9f44-823efc771717 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:27.241739 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f8b6d541-83a7-44cd-9f44-823efc771717 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.189457 May 19 12:25:27.243165 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 108/210] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:27 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:27.292734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d3ce4e3a-d990-45c5-91a2-7db753681b89 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:27.293342 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d3ce4e3a-d990-45c5-91a2-7db753681b89 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:27.300450 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3ce4e3a-d990-45c5-91a2-7db753681b89 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:27.301142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3ce4e3a-d990-45c5-91a2-7db753681b89 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:27.301912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3ce4e3a-d990-45c5-91a2-7db753681b89 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:27.302518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3ce4e3a-d990-45c5-91a2-7db753681b89 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:27.440675 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d3ce4e3a-d990-45c5-91a2-7db753681b89 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:27.455571 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d3ce4e3a-d990-45c5-91a2-7db753681b89 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:27.455571 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d3ce4e3a-d990-45c5-91a2-7db753681b89 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:27.455571 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d3ce4e3a-d990-45c5-91a2-7db753681b89 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.163736 May 19 12:25:27.464074 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 109/211] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:27 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:27.877298 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-71b2b188-4abb-4d35-b601-0e0f847b4b45 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:27.877891 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-71b2b188-4abb-4d35-b601-0e0f847b4b45 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:27.884151 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-71b2b188-4abb-4d35-b601-0e0f847b4b45 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:27.884597 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-71b2b188-4abb-4d35-b601-0e0f847b4b45 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:27.885364 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-71b2b188-4abb-4d35-b601-0e0f847b4b45 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:27.885795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-71b2b188-4abb-4d35-b601-0e0f847b4b45 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:28.022253 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-71b2b188-4abb-4d35-b601-0e0f847b4b45 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:28.030143 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-71b2b188-4abb-4d35-b601-0e0f847b4b45 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.157737 May 19 12:25:28.031383 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 110/212] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:27 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:28.260270 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b737357b-2330-4a73-9d0d-8bc67448e71d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:28.260930 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b737357b-2330-4a73-9d0d-8bc67448e71d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:28.267872 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b737357b-2330-4a73-9d0d-8bc67448e71d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:28.268327 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b737357b-2330-4a73-9d0d-8bc67448e71d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:28.269110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b737357b-2330-4a73-9d0d-8bc67448e71d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:28.269782 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b737357b-2330-4a73-9d0d-8bc67448e71d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:28.407683 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b737357b-2330-4a73-9d0d-8bc67448e71d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:28.415532 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b737357b-2330-4a73-9d0d-8bc67448e71d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.159049 May 19 12:25:28.416154 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 111/213] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:28 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:28.472442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a0d7a2d7-d159-409d-be85-bbd7cc027e07 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:28.473042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a0d7a2d7-d159-409d-be85-bbd7cc027e07 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:28.479237 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a0d7a2d7-d159-409d-be85-bbd7cc027e07 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:28.479681 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a0d7a2d7-d159-409d-be85-bbd7cc027e07 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:28.480464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a0d7a2d7-d159-409d-be85-bbd7cc027e07 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:28.480892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a0d7a2d7-d159-409d-be85-bbd7cc027e07 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:28.497470 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:28.617177 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a0d7a2d7-d159-409d-be85-bbd7cc027e07 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:28.626138 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a0d7a2d7-d159-409d-be85-bbd7cc027e07 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:28.627723 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a0d7a2d7-d159-409d-be85-bbd7cc027e07 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:28.628917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a0d7a2d7-d159-409d-be85-bbd7cc027e07 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.161771 May 19 12:25:28.629487 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 112/214] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:28 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:25:29.047857 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-61406b0b-93d0-46ed-a6c9-9c32b6a993e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:29.048463 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-61406b0b-93d0-46ed-a6c9-9c32b6a993e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:29.054821 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-61406b0b-93d0-46ed-a6c9-9c32b6a993e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:29.055267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-61406b0b-93d0-46ed-a6c9-9c32b6a993e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:29.056033 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-61406b0b-93d0-46ed-a6c9-9c32b6a993e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:29.056467 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-61406b0b-93d0-46ed-a6c9-9c32b6a993e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:29.200775 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-61406b0b-93d0-46ed-a6c9-9c32b6a993e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:29.208451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-61406b0b-93d0-46ed-a6c9-9c32b6a993e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.164925 May 19 12:25:29.209036 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 113/215] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:29 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:29.433171 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-804759f1-b333-474b-832e-10f9d6707788 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:29.433878 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-804759f1-b333-474b-832e-10f9d6707788 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:29.436253 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:29.442685 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-804759f1-b333-474b-832e-10f9d6707788 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:29.443132 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-804759f1-b333-474b-832e-10f9d6707788 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:29.443947 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-804759f1-b333-474b-832e-10f9d6707788 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:29.444406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-804759f1-b333-474b-832e-10f9d6707788 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:29.612778 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-804759f1-b333-474b-832e-10f9d6707788 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:29.620570 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-804759f1-b333-474b-832e-10f9d6707788 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.191226 May 19 12:25:29.621149 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 114/216] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:29 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:29.650853 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f1e4dc7a-6091-4f67-af87-e8da449be989 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:29.652016 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f1e4dc7a-6091-4f67-af87-e8da449be989 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:29.664841 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f1e4dc7a-6091-4f67-af87-e8da449be989 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:29.665611 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f1e4dc7a-6091-4f67-af87-e8da449be989 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:29.667045 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f1e4dc7a-6091-4f67-af87-e8da449be989 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:29.667818 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f1e4dc7a-6091-4f67-af87-e8da449be989 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:29.856714 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f1e4dc7a-6091-4f67-af87-e8da449be989 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:29.872527 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f1e4dc7a-6091-4f67-af87-e8da449be989 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:29.874197 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f1e4dc7a-6091-4f67-af87-e8da449be989 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:29.875929 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f1e4dc7a-6091-4f67-af87-e8da449be989 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.232539 May 19 12:25:29.876507 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 115/217] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:29 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:25:30.229027 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e0239a59-8543-4bd4-86cd-a2e9898b3ffc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:30.230163 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e0239a59-8543-4bd4-86cd-a2e9898b3ffc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:30.239962 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e0239a59-8543-4bd4-86cd-a2e9898b3ffc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:30.240768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e0239a59-8543-4bd4-86cd-a2e9898b3ffc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:30.242033 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e0239a59-8543-4bd4-86cd-a2e9898b3ffc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:30.242912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e0239a59-8543-4bd4-86cd-a2e9898b3ffc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:30.399006 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e0239a59-8543-4bd4-86cd-a2e9898b3ffc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:30.407797 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e0239a59-8543-4bd4-86cd-a2e9898b3ffc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.185194 May 19 12:25:30.408413 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 116/218] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:30 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:30.637350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-50aaf3e4-ba10-411b-b891-f5fd37c47fcf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:30.637969 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-50aaf3e4-ba10-411b-b891-f5fd37c47fcf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:30.645083 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-50aaf3e4-ba10-411b-b891-f5fd37c47fcf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:30.645518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-50aaf3e4-ba10-411b-b891-f5fd37c47fcf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:30.646288 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-50aaf3e4-ba10-411b-b891-f5fd37c47fcf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:30.646756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-50aaf3e4-ba10-411b-b891-f5fd37c47fcf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:30.793612 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-50aaf3e4-ba10-411b-b891-f5fd37c47fcf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:30.805147 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-50aaf3e4-ba10-411b-b891-f5fd37c47fcf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.168847 May 19 12:25:30.805147 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 117/219] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:30 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:30.895995 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-7b624e12-c5d5-46b4-9ad2-d55e08e3c55d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:30.896556 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-7b624e12-c5d5-46b4-9ad2-d55e08e3c55d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:30.903265 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7b624e12-c5d5-46b4-9ad2-d55e08e3c55d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:30.903714 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7b624e12-c5d5-46b4-9ad2-d55e08e3c55d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:30.904489 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7b624e12-c5d5-46b4-9ad2-d55e08e3c55d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:30.904927 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7b624e12-c5d5-46b4-9ad2-d55e08e3c55d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:31.050597 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-7b624e12-c5d5-46b4-9ad2-d55e08e3c55d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:31.062344 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-7b624e12-c5d5-46b4-9ad2-d55e08e3c55d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:31.063916 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-7b624e12-c5d5-46b4-9ad2-d55e08e3c55d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:31.065121 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-7b624e12-c5d5-46b4-9ad2-d55e08e3c55d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.173326 May 19 12:25:31.065715 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 118/220] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:30 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:25:31.387115 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-25f13610-54cd-4bb2-83d3-dcb8f2a2a519 req-a0a9004e-be71-4730-b832-5388c57a3a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac0842f-dd21-479d-894c-1080f1531013", "name": "network-vif-plugged", "status": "completed", "tag": "2ce047fc-9ae8-4336-a545-1e048200c75a"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:31.404382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-25f13610-54cd-4bb2-83d3-dcb8f2a2a519 req-a0a9004e-be71-4730-b832-5388c57a3a73 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:31.405270 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-25f13610-54cd-4bb2-83d3-dcb8f2a2a519 req-a0a9004e-be71-4730-b832-5388c57a3a73 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:31.437686 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-25f13610-54cd-4bb2-83d3-dcb8f2a2a519 req-a0a9004e-be71-4730-b832-5388c57a3a73 service nova] Creating event network-vif-plugged:2ce047fc-9ae8-4336-a545-1e048200c75a for instance 1ac0842f-dd21-479d-894c-1080f1531013 on hv-cinder-77819 May 19 12:25:31.444455 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-25f13610-54cd-4bb2-83d3-dcb8f2a2a519 req-a0a9004e-be71-4730-b832-5388c57a3a73 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065892 May 19 12:25:31.445339 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 119/221] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:25:31.455768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b4836006-6301-4ddb-8f30-7cf9ff4d832f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:31.457527 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b4836006-6301-4ddb-8f30-7cf9ff4d832f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:31.463218 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b4836006-6301-4ddb-8f30-7cf9ff4d832f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:31.463663 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b4836006-6301-4ddb-8f30-7cf9ff4d832f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:31.464431 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b4836006-6301-4ddb-8f30-7cf9ff4d832f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:31.464866 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b4836006-6301-4ddb-8f30-7cf9ff4d832f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:31.616417 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b4836006-6301-4ddb-8f30-7cf9ff4d832f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:31.627410 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b4836006-6301-4ddb-8f30-7cf9ff4d832f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.178071 May 19 12:25:31.628237 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 120/222] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:31 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:31.642781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1320212772", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "networks": [{"uuid": "2a706f2f-b53b-4a57-8c78-98defdba4774"}]}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:31.700022 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.network.neutron [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] validate_networks() for [('2a706f2f-b53b-4a57-8c78-98defdba4774', None, None, None, None, None)] {{(pid=118112) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:25:32.093794 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Flavor limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:25:32.094211 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Image limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:25:32.094772 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Flavor pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:25:32.095180 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Image pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:25:32.095786 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:25:32.106444 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.106991 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.107852 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.108242 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.128114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Getting quotas for project 9f556df7a95041279685098584415ed1. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:25:32.132738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Getting quotas for user 7caa126f7eab4eef8db03374e82a6ab9 and project 9f556df7a95041279685098584415ed1. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:25:32.147286 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Going to run 1 instances... {{(pid=118112) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:25:32.151918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:25:32.341536 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-81fafd4f-c234-4e3e-8e54-88b296b0b099 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702724 May 19 12:25:32.342134 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 121/223] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:25:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:25:32.348684 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-bac852d0-b6fb-4578-a955-a8c3ff06c856 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:32.349289 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-bac852d0-b6fb-4578-a955-a8c3ff06c856 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:32.356171 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bac852d0-b6fb-4578-a955-a8c3ff06c856 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.356600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bac852d0-b6fb-4578-a955-a8c3ff06c856 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.357580 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bac852d0-b6fb-4578-a955-a8c3ff06c856 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.359381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bac852d0-b6fb-4578-a955-a8c3ff06c856 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.531272 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bac852d0-b6fb-4578-a955-a8c3ff06c856 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:32.539310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-bac852d0-b6fb-4578-a955-a8c3ff06c856 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.195910 May 19 12:25:32.539876 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 122/224] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:32 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:32.544669 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1bf61d7d-1a6b-4576-ae66-5c422de23104 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:32.545476 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1bf61d7d-1a6b-4576-ae66-5c422de23104 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:32.554957 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1bf61d7d-1a6b-4576-ae66-5c422de23104 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.555435 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1bf61d7d-1a6b-4576-ae66-5c422de23104 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.556208 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1bf61d7d-1a6b-4576-ae66-5c422de23104 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.556639 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1bf61d7d-1a6b-4576-ae66-5c422de23104 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.714231 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1bf61d7d-1a6b-4576-ae66-5c422de23104 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:32.723978 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1bf61d7d-1a6b-4576-ae66-5c422de23104 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:32.725909 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1bf61d7d-1a6b-4576-ae66-5c422de23104 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:32.727204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1bf61d7d-1a6b-4576-ae66-5c422de23104 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.186410 May 19 12:25:32.728456 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 123/225] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:32 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:32.735483 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ace49a2e-11ce-43dc-a609-6aa6c795e5ee tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:32.736277 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ace49a2e-11ce-43dc-a609-6aa6c795e5ee tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:32.803193 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ace49a2e-11ce-43dc-a609-6aa6c795e5ee tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:32.810535 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ace49a2e-11ce-43dc-a609-6aa6c795e5ee tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1214 microversion: 2.1 time: 0.081729 May 19 12:25:32.811300 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 124/226] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:32 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:32.820201 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b5d5b44f-0602-4b9e-a5e9-8c99652b73e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:32.821581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b5d5b44f-0602-4b9e-a5e9-8c99652b73e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:32.827914 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b5d5b44f-0602-4b9e-a5e9-8c99652b73e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.829530 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b5d5b44f-0602-4b9e-a5e9-8c99652b73e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.830330 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b5d5b44f-0602-4b9e-a5e9-8c99652b73e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:32.831327 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b5d5b44f-0602-4b9e-a5e9-8c99652b73e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:32.998368 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b5d5b44f-0602-4b9e-a5e9-8c99652b73e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:33.014779 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b5d5b44f-0602-4b9e-a5e9-8c99652b73e5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.201394 May 19 12:25:33.016724 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 125/227] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:32 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:33.560189 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a4487f30-e933-4850-9951-85f47fdc3570 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:33.561468 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a4487f30-e933-4850-9951-85f47fdc3570 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:33.572770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a4487f30-e933-4850-9951-85f47fdc3570 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:33.573497 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a4487f30-e933-4850-9951-85f47fdc3570 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:33.574862 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a4487f30-e933-4850-9951-85f47fdc3570 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:33.575819 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a4487f30-e933-4850-9951-85f47fdc3570 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:33.790741 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a4487f30-e933-4850-9951-85f47fdc3570 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:33.800732 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a4487f30-e933-4850-9951-85f47fdc3570 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1322 microversion: 2.1 time: 0.246257 May 19 12:25:33.801710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 126/228] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:33 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:33.808836 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-14128af7-8286-441e-98ff-96fcbd695740 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:33.809443 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-14128af7-8286-441e-98ff-96fcbd695740 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:33.817113 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-14128af7-8286-441e-98ff-96fcbd695740 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:33.817609 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-14128af7-8286-441e-98ff-96fcbd695740 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:33.818348 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-14128af7-8286-441e-98ff-96fcbd695740 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:33.819166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-14128af7-8286-441e-98ff-96fcbd695740 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:33.983746 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-14128af7-8286-441e-98ff-96fcbd695740 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:33.992461 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-14128af7-8286-441e-98ff-96fcbd695740 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:33.993979 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-14128af7-8286-441e-98ff-96fcbd695740 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:34.013569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-14128af7-8286-441e-98ff-96fcbd695740 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.190412 May 19 12:25:34.013569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 127/229] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:33 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:34.013569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-72c64736-8cff-4c34-bb6e-b79fb82e675d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:34.013569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-72c64736-8cff-4c34-bb6e-b79fb82e675d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:34.013569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-72c64736-8cff-4c34-bb6e-b79fb82e675d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:34.014120 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-72c64736-8cff-4c34-bb6e-b79fb82e675d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:34.014120 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-72c64736-8cff-4c34-bb6e-b79fb82e675d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:34.014120 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-72c64736-8cff-4c34-bb6e-b79fb82e675d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:34.115605 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-72c64736-8cff-4c34-bb6e-b79fb82e675d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:34.127578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-72c64736-8cff-4c34-bb6e-b79fb82e675d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1218 microversion: 2.1 time: 0.130401 May 19 12:25:34.128656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 128/230] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:33 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:34.139466 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-7c918ff5-efab-4958-acd6-89d9a85127b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:34.140863 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-7c918ff5-efab-4958-acd6-89d9a85127b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:34.151501 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7c918ff5-efab-4958-acd6-89d9a85127b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:34.152297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7c918ff5-efab-4958-acd6-89d9a85127b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:34.153369 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7c918ff5-efab-4958-acd6-89d9a85127b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:34.153804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7c918ff5-efab-4958-acd6-89d9a85127b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:34.325716 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-7c918ff5-efab-4958-acd6-89d9a85127b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:34.334673 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-7c918ff5-efab-4958-acd6-89d9a85127b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.204386 May 19 12:25:34.335347 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 129/231] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:34 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:34.402643 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2e551e9e-4aa2-4e6c-b24b-5731c24b767e tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "POST /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.602482 May 19 12:25:34.404482 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 103/232] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:25:25 2022] POST /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e/os-volume_attachments => generated 194 bytes in 8606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:25:34.820549 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ac6eb146-93e2-4a47-8e58-346600222c88 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:34.821312 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ac6eb146-93e2-4a47-8e58-346600222c88 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:34.829388 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ac6eb146-93e2-4a47-8e58-346600222c88 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:34.829843 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ac6eb146-93e2-4a47-8e58-346600222c88 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:34.830940 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ac6eb146-93e2-4a47-8e58-346600222c88 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:34.831382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ac6eb146-93e2-4a47-8e58-346600222c88 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.015965 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a19e5eef-c9da-4f16-ae9a-5f9055ff4872 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:35.016840 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a19e5eef-c9da-4f16-ae9a-5f9055ff4872 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:35.025081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a19e5eef-c9da-4f16-ae9a-5f9055ff4872 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.025731 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a19e5eef-c9da-4f16-ae9a-5f9055ff4872 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.027107 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a19e5eef-c9da-4f16-ae9a-5f9055ff4872 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.027637 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a19e5eef-c9da-4f16-ae9a-5f9055ff4872 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.113969 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ac6eb146-93e2-4a47-8e58-346600222c88 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:35.124887 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ac6eb146-93e2-4a47-8e58-346600222c88 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1516 microversion: 2.1 time: 0.309860 May 19 12:25:35.126142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 130/233] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:34 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:35.152426 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d14c53fb-9ac2-4ca9-9d8c-3842dc8b77be tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:35.155400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d14c53fb-9ac2-4ca9-9d8c-3842dc8b77be tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:35.167156 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d14c53fb-9ac2-4ca9-9d8c-3842dc8b77be tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.168375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d14c53fb-9ac2-4ca9-9d8c-3842dc8b77be tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.170015 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d14c53fb-9ac2-4ca9-9d8c-3842dc8b77be tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.171692 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d14c53fb-9ac2-4ca9-9d8c-3842dc8b77be tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.196677 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:35.228222 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-d14c53fb-9ac2-4ca9-9d8c-3842dc8b77be tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lazy-loading 'flavor' on Instance uuid 99e6669b-4005-4691-9a9e-42cd9f209a44 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:25:35.288527 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a19e5eef-c9da-4f16-ae9a-5f9055ff4872 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:35.297917 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a19e5eef-c9da-4f16-ae9a-5f9055ff4872 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:35.300410 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a19e5eef-c9da-4f16-ae9a-5f9055ff4872 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:35.301622 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a19e5eef-c9da-4f16-ae9a-5f9055ff4872 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.291258 May 19 12:25:35.313425 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 104/234] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:35 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:25:35.319558 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-57bdb348-1e34-46b4-b78c-ae41663c2640 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:35.320384 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-57bdb348-1e34-46b4-b78c-ae41663c2640 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:35.328454 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-57bdb348-1e34-46b4-b78c-ae41663c2640 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.329146 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-57bdb348-1e34-46b4-b78c-ae41663c2640 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.330075 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-57bdb348-1e34-46b4-b78c-ae41663c2640 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.330677 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-57bdb348-1e34-46b4-b78c-ae41663c2640 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.414726 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-57bdb348-1e34-46b4-b78c-ae41663c2640 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:35.427681 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-57bdb348-1e34-46b4-b78c-ae41663c2640 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1210 microversion: 2.1 time: 0.112403 May 19 12:25:35.428297 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 105/235] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:35 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:35.441661 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-04f2d6a6-f563-4e60-8cc3-f29e13addddf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:35.442342 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-04f2d6a6-f563-4e60-8cc3-f29e13addddf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:35.448944 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-04f2d6a6-f563-4e60-8cc3-f29e13addddf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.450053 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-04f2d6a6-f563-4e60-8cc3-f29e13addddf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.450176 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-04f2d6a6-f563-4e60-8cc3-f29e13addddf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.450630 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-04f2d6a6-f563-4e60-8cc3-f29e13addddf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.634081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-04f2d6a6-f563-4e60-8cc3-f29e13addddf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:35.643495 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-04f2d6a6-f563-4e60-8cc3-f29e13addddf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.213789 May 19 12:25:35.644108 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 106/236] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:35 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:35.810013 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d14c53fb-9ac2-4ca9-9d8c-3842dc8b77be tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "POST /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44/action" status: 200 len: 32 microversion: 2.1 time: 0.666546 May 19 12:25:35.810721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 131/237] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:25:35 2022] POST /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44/action => generated 32 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:25:35.823752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dd1ce423-b82d-4d75-b0f5-5301f68cd5b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:35.824587 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dd1ce423-b82d-4d75-b0f5-5301f68cd5b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:35.831949 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dd1ce423-b82d-4d75-b0f5-5301f68cd5b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.832436 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dd1ce423-b82d-4d75-b0f5-5301f68cd5b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:35.833592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dd1ce423-b82d-4d75-b0f5-5301f68cd5b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:35.834086 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dd1ce423-b82d-4d75-b0f5-5301f68cd5b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:36.011088 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dd1ce423-b82d-4d75-b0f5-5301f68cd5b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:36.035149 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dd1ce423-b82d-4d75-b0f5-5301f68cd5b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.217895 May 19 12:25:36.037972 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 107/238] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:35 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:36.321234 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8df35cb6-dfb9-453d-8b05-37bcad1a1045 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:36.322764 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8df35cb6-dfb9-453d-8b05-37bcad1a1045 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:36.330106 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8df35cb6-dfb9-453d-8b05-37bcad1a1045 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:36.330584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8df35cb6-dfb9-453d-8b05-37bcad1a1045 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:36.331362 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8df35cb6-dfb9-453d-8b05-37bcad1a1045 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:36.331798 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8df35cb6-dfb9-453d-8b05-37bcad1a1045 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:36.451613 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bfba6e3f-2024-409a-a710-3906d500cc7c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:36.453179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bfba6e3f-2024-409a-a710-3906d500cc7c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:36.461620 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfba6e3f-2024-409a-a710-3906d500cc7c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:36.463109 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfba6e3f-2024-409a-a710-3906d500cc7c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:36.464579 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfba6e3f-2024-409a-a710-3906d500cc7c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:36.465248 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfba6e3f-2024-409a-a710-3906d500cc7c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:36.500213 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8df35cb6-dfb9-453d-8b05-37bcad1a1045 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:36.509775 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8df35cb6-dfb9-453d-8b05-37bcad1a1045 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:36.511579 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8df35cb6-dfb9-453d-8b05-37bcad1a1045 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:36.512724 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8df35cb6-dfb9-453d-8b05-37bcad1a1045 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1406 microversion: 2.20 time: 0.196255 May 19 12:25:36.513288 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 132/239] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:36 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:25:36.544749 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bfba6e3f-2024-409a-a710-3906d500cc7c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:36.556565 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bfba6e3f-2024-409a-a710-3906d500cc7c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1266 microversion: 2.1 time: 0.108887 May 19 12:25:36.557490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 108/240] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:36 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:36.661051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-65b7aa85-ced9-45e2-90eb-1d70f772b6fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:36.661676 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-65b7aa85-ced9-45e2-90eb-1d70f772b6fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:36.667889 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-65b7aa85-ced9-45e2-90eb-1d70f772b6fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:36.668335 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-65b7aa85-ced9-45e2-90eb-1d70f772b6fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:36.669379 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-65b7aa85-ced9-45e2-90eb-1d70f772b6fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:36.669855 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-65b7aa85-ced9-45e2-90eb-1d70f772b6fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:36.822543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-65b7aa85-ced9-45e2-90eb-1d70f772b6fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:36.833255 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-65b7aa85-ced9-45e2-90eb-1d70f772b6fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.175897 May 19 12:25:36.847709 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 133/241] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:36 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:37.053673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2eb72b9c-8c12-42b9-b748-743d350e0214 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:37.054287 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2eb72b9c-8c12-42b9-b748-743d350e0214 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:37.060504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2eb72b9c-8c12-42b9-b748-743d350e0214 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.060950 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2eb72b9c-8c12-42b9-b748-743d350e0214 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.062316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2eb72b9c-8c12-42b9-b748-743d350e0214 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.062976 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2eb72b9c-8c12-42b9-b748-743d350e0214 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.268134 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2eb72b9c-8c12-42b9-b748-743d350e0214 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:37.281068 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2eb72b9c-8c12-42b9-b748-743d350e0214 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.231384 May 19 12:25:37.281949 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 109/242] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:37 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:37.531051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a9c9699f-a1f9-4ee0-80a0-f7f5d65da519 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:37.532167 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a9c9699f-a1f9-4ee0-80a0-f7f5d65da519 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:37.538565 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a9c9699f-a1f9-4ee0-80a0-f7f5d65da519 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.539111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a9c9699f-a1f9-4ee0-80a0-f7f5d65da519 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.539947 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a9c9699f-a1f9-4ee0-80a0-f7f5d65da519 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.540446 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a9c9699f-a1f9-4ee0-80a0-f7f5d65da519 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.575388 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d14122ac-dbe1-4d7c-bc3c-7c6136af7333 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:37.576013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d14122ac-dbe1-4d7c-bc3c-7c6136af7333 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:37.587571 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d14122ac-dbe1-4d7c-bc3c-7c6136af7333 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.588528 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d14122ac-dbe1-4d7c-bc3c-7c6136af7333 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.591272 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d14122ac-dbe1-4d7c-bc3c-7c6136af7333 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.592045 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d14122ac-dbe1-4d7c-bc3c-7c6136af7333 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.820180 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d14122ac-dbe1-4d7c-bc3c-7c6136af7333 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:37.840219 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d14122ac-dbe1-4d7c-bc3c-7c6136af7333 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1274 microversion: 2.1 time: 0.262378 May 19 12:25:37.852649 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 110/243] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:37 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1274 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:37.857491 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ce37a36f-f83f-429d-87bb-3fbcc0e38296 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:37.861978 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ce37a36f-f83f-429d-87bb-3fbcc0e38296 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:37.872070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ce37a36f-f83f-429d-87bb-3fbcc0e38296 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.872781 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ce37a36f-f83f-429d-87bb-3fbcc0e38296 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.875658 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ce37a36f-f83f-429d-87bb-3fbcc0e38296 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.876490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ce37a36f-f83f-429d-87bb-3fbcc0e38296 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.891384 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a9c9699f-a1f9-4ee0-80a0-f7f5d65da519 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:37.907551 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a9c9699f-a1f9-4ee0-80a0-f7f5d65da519 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:37.909214 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a9c9699f-a1f9-4ee0-80a0-f7f5d65da519 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:37.914279 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a9c9699f-a1f9-4ee0-80a0-f7f5d65da519 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1598 microversion: 2.20 time: 0.383378 May 19 12:25:37.926004 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 134/244] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:25:37 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1598 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:25:37.938500 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ac51b658-08cb-4c42-8a46-8df09703a381 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:37.939004 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ac51b658-08cb-4c42-8a46-8df09703a381 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:37.961477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ac51b658-08cb-4c42-8a46-8df09703a381 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.961942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ac51b658-08cb-4c42-8a46-8df09703a381 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:37.963234 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ac51b658-08cb-4c42-8a46-8df09703a381 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:37.963693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ac51b658-08cb-4c42-8a46-8df09703a381 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:38.116903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ac51b658-08cb-4c42-8a46-8df09703a381 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.182874 May 19 12:25:38.118155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 135/245] 10.222.0.57 () {60 vars in 1315 bytes} [Thu May 19 12:25:37 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:25:38.145032 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-151ed22d-7e0c-4435-9921-10b2df86638b req-d79bc17f-4769-418e-910c-643875f5ac4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba02619-c806-4c69-bef7-857d2fc19405", "name": "network-vif-plugged", "status": "completed", "tag": "6e55cf88-9446-44e0-ba62-600e8724a7ee"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:38.162775 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ce37a36f-f83f-429d-87bb-3fbcc0e38296 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:38.165796 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-151ed22d-7e0c-4435-9921-10b2df86638b req-d79bc17f-4769-418e-910c-643875f5ac4f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:38.166432 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-151ed22d-7e0c-4435-9921-10b2df86638b req-d79bc17f-4769-418e-910c-643875f5ac4f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:38.171649 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ce37a36f-f83f-429d-87bb-3fbcc0e38296 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.317616 May 19 12:25:38.172342 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 111/246] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:37 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:38.197394 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-151ed22d-7e0c-4435-9921-10b2df86638b req-d79bc17f-4769-418e-910c-643875f5ac4f service nova] Creating event network-vif-plugged:6e55cf88-9446-44e0-ba62-600e8724a7ee for instance 0ba02619-c806-4c69-bef7-857d2fc19405 on hv-cinder-77819 May 19 12:25:38.204693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-151ed22d-7e0c-4435-9921-10b2df86638b req-d79bc17f-4769-418e-910c-643875f5ac4f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074149 May 19 12:25:38.205995 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 136/247] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:38.306220 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a92d0a20-db11-4c3d-95a8-0dd7cd77f884 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:38.306893 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a92d0a20-db11-4c3d-95a8-0dd7cd77f884 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:38.319133 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a92d0a20-db11-4c3d-95a8-0dd7cd77f884 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:38.319909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a92d0a20-db11-4c3d-95a8-0dd7cd77f884 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:38.320857 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a92d0a20-db11-4c3d-95a8-0dd7cd77f884 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:38.321444 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a92d0a20-db11-4c3d-95a8-0dd7cd77f884 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:38.615491 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a92d0a20-db11-4c3d-95a8-0dd7cd77f884 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:38.624537 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a92d0a20-db11-4c3d-95a8-0dd7cd77f884 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.322089 May 19 12:25:38.625129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 112/248] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:38 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:38.860640 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1a43a9a3-81dd-4fe1-a04a-048263f916dc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:38.861319 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1a43a9a3-81dd-4fe1-a04a-048263f916dc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:38.871146 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1a43a9a3-81dd-4fe1-a04a-048263f916dc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:38.872217 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1a43a9a3-81dd-4fe1-a04a-048263f916dc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:38.873082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1a43a9a3-81dd-4fe1-a04a-048263f916dc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:38.873598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1a43a9a3-81dd-4fe1-a04a-048263f916dc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:38.977630 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1a43a9a3-81dd-4fe1-a04a-048263f916dc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:39.002127 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1a43a9a3-81dd-4fe1-a04a-048263f916dc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1272 microversion: 2.1 time: 0.144151 May 19 12:25:39.007307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 137/249] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:38 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:39.196732 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d3de2ac5-f220-4570-baa4-9cf9d5f0b8d1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:39.196732 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d3de2ac5-f220-4570-baa4-9cf9d5f0b8d1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:39.199490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3de2ac5-f220-4570-baa4-9cf9d5f0b8d1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:39.199982 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3de2ac5-f220-4570-baa4-9cf9d5f0b8d1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:39.200757 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3de2ac5-f220-4570-baa4-9cf9d5f0b8d1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:39.201294 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3de2ac5-f220-4570-baa4-9cf9d5f0b8d1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:39.361779 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d3de2ac5-f220-4570-baa4-9cf9d5f0b8d1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:39.372572 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d3de2ac5-f220-4570-baa4-9cf9d5f0b8d1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.185846 May 19 12:25:39.373248 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 113/250] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:39 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:39.642452 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-571a5b22-f8d0-45b4-ab55-734a67939e3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:39.643188 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-571a5b22-f8d0-45b4-ab55-734a67939e3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:39.652349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-571a5b22-f8d0-45b4-ab55-734a67939e3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:39.653842 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-571a5b22-f8d0-45b4-ab55-734a67939e3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:39.655717 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-571a5b22-f8d0-45b4-ab55-734a67939e3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:39.656874 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-571a5b22-f8d0-45b4-ab55-734a67939e3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:39.839619 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-571a5b22-f8d0-45b4-ab55-734a67939e3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:39.848331 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-571a5b22-f8d0-45b4-ab55-734a67939e3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.211034 May 19 12:25:39.849156 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 138/251] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:39 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:40.024188 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9d92954f-7446-4feb-9f84-afc8826536ce tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:40.025441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9d92954f-7446-4feb-9f84-afc8826536ce tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:40.028380 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=92 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:40.042694 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d92954f-7446-4feb-9f84-afc8826536ce tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:40.050562 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d92954f-7446-4feb-9f84-afc8826536ce tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:40.050562 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d92954f-7446-4feb-9f84-afc8826536ce tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:40.050562 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d92954f-7446-4feb-9f84-afc8826536ce tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:40.226027 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9d92954f-7446-4feb-9f84-afc8826536ce tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:40.240291 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9d92954f-7446-4feb-9f84-afc8826536ce tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1314 microversion: 2.1 time: 0.219898 May 19 12:25:40.250923 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 114/252] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:40 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:40.379403 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-53c15cea-69fb-4893-968c-f8a95e469e4f req-c8ffa132-3b2e-4fd7-a8a1-4c6c22e425f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac0842f-dd21-479d-894c-1080f1531013", "tag": "2ce047fc-9ae8-4336-a545-1e048200c75a"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:40.390951 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-486ae05f-edd9-4921-a0db-330ad200423c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:40.391611 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-486ae05f-edd9-4921-a0db-330ad200423c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:40.397477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-53c15cea-69fb-4893-968c-f8a95e469e4f req-c8ffa132-3b2e-4fd7-a8a1-4c6c22e425f1 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:40.399941 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-486ae05f-edd9-4921-a0db-330ad200423c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:40.400491 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-486ae05f-edd9-4921-a0db-330ad200423c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:40.401065 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-53c15cea-69fb-4893-968c-f8a95e469e4f req-c8ffa132-3b2e-4fd7-a8a1-4c6c22e425f1 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:40.401430 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-486ae05f-edd9-4921-a0db-330ad200423c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:40.402055 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-486ae05f-edd9-4921-a0db-330ad200423c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:40.432073 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-53c15cea-69fb-4893-968c-f8a95e469e4f req-c8ffa132-3b2e-4fd7-a8a1-4c6c22e425f1 service nova] Creating event network-changed:2ce047fc-9ae8-4336-a545-1e048200c75a for instance 1ac0842f-dd21-479d-894c-1080f1531013 on hv-cinder-77819 May 19 12:25:40.442079 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-53c15cea-69fb-4893-968c-f8a95e469e4f req-c8ffa132-3b2e-4fd7-a8a1-4c6c22e425f1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066275 May 19 12:25:40.444533 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 139/253] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:40.591189 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-486ae05f-edd9-4921-a0db-330ad200423c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:40.594052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:40.620060 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-486ae05f-edd9-4921-a0db-330ad200423c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.234257 May 19 12:25:40.633955 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 115/254] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:40 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:40.872604 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-227184fb-df78-454a-a85e-aaaab576ede1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:40.876155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-227184fb-df78-454a-a85e-aaaab576ede1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:40.896277 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-227184fb-df78-454a-a85e-aaaab576ede1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:40.897415 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-227184fb-df78-454a-a85e-aaaab576ede1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:40.899168 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-227184fb-df78-454a-a85e-aaaab576ede1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:40.900517 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-227184fb-df78-454a-a85e-aaaab576ede1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:41.234977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-227184fb-df78-454a-a85e-aaaab576ede1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:41.262225 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-227184fb-df78-454a-a85e-aaaab576ede1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.393281 May 19 12:25:41.269869 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 140/255] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:40 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:41.285089 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c9d1d7f4-782c-4d51-bbb0-ff97e75b98b4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:41.286067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c9d1d7f4-782c-4d51-bbb0-ff97e75b98b4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:41.320647 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c9d1d7f4-782c-4d51-bbb0-ff97e75b98b4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:41.320647 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c9d1d7f4-782c-4d51-bbb0-ff97e75b98b4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:41.320647 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c9d1d7f4-782c-4d51-bbb0-ff97e75b98b4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:41.320647 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c9d1d7f4-782c-4d51-bbb0-ff97e75b98b4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:41.480269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c9d1d7f4-782c-4d51-bbb0-ff97e75b98b4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:41.500032 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c9d1d7f4-782c-4d51-bbb0-ff97e75b98b4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1314 microversion: 2.1 time: 0.245343 May 19 12:25:41.501243 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 116/256] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:41 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:41.640521 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6fca17b6-532a-466a-8d74-e95bf610eebe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:41.641656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6fca17b6-532a-466a-8d74-e95bf610eebe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:41.651457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6fca17b6-532a-466a-8d74-e95bf610eebe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:41.652521 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6fca17b6-532a-466a-8d74-e95bf610eebe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:41.654021 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6fca17b6-532a-466a-8d74-e95bf610eebe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:41.654793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6fca17b6-532a-466a-8d74-e95bf610eebe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:41.867585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6fca17b6-532a-466a-8d74-e95bf610eebe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:41.880521 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6fca17b6-532a-466a-8d74-e95bf610eebe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1367 microversion: 2.1 time: 0.244697 May 19 12:25:41.890902 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 141/257] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:41 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:42.292062 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2e899001-8676-48f2-95c8-23bbe7c3c320 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:42.293656 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2e899001-8676-48f2-95c8-23bbe7c3c320 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:42.303458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2e899001-8676-48f2-95c8-23bbe7c3c320 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:42.304339 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2e899001-8676-48f2-95c8-23bbe7c3c320 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:42.305800 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2e899001-8676-48f2-95c8-23bbe7c3c320 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:42.306470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2e899001-8676-48f2-95c8-23bbe7c3c320 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:42.466349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-4d20b1fa-4acc-4c1e-9569-d7c376421417 req-ac87a2cc-90ab-430d-8e51-8338243555b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82eb59af-b07c-4b0a-9a14-596ee9d70b44", "tag": "798a721b-76d2-4afc-a9c4-c752be3ca25f"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:42.478785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:42.482566 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-4d20b1fa-4acc-4c1e-9569-d7c376421417 req-ac87a2cc-90ab-430d-8e51-8338243555b7 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:42.484453 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-4d20b1fa-4acc-4c1e-9569-d7c376421417 req-ac87a2cc-90ab-430d-8e51-8338243555b7 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:42.499792 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-4d20b1fa-4acc-4c1e-9569-d7c376421417 req-ac87a2cc-90ab-430d-8e51-8338243555b7 service nova] Creating event network-changed:798a721b-76d2-4afc-a9c4-c752be3ca25f for instance 82eb59af-b07c-4b0a-9a14-596ee9d70b44 on hv-cinder-77819 May 19 12:25:42.508218 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-4d20b1fa-4acc-4c1e-9569-d7c376421417 req-ac87a2cc-90ab-430d-8e51-8338243555b7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046155 May 19 12:25:42.510265 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 142/258] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:25:42.526176 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a294d96f-7dc5-4a46-9b74-1432ad90a1b0 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:42.528779 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a294d96f-7dc5-4a46-9b74-1432ad90a1b0 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:42.542305 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a294d96f-7dc5-4a46-9b74-1432ad90a1b0 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:42.543173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a294d96f-7dc5-4a46-9b74-1432ad90a1b0 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:42.544846 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a294d96f-7dc5-4a46-9b74-1432ad90a1b0 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:42.545486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a294d96f-7dc5-4a46-9b74-1432ad90a1b0 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:42.565210 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2e899001-8676-48f2-95c8-23bbe7c3c320 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:42.573452 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2e899001-8676-48f2-95c8-23bbe7c3c320 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.290128 May 19 12:25:42.574840 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 117/259] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:42 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:42.716445 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a294d96f-7dc5-4a46-9b74-1432ad90a1b0 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:42.730563 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a294d96f-7dc5-4a46-9b74-1432ad90a1b0 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1314 microversion: 2.1 time: 0.209977 May 19 12:25:42.731500 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 143/260] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:42 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:42.897963 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-41e8f6fe-c4ea-4bc9-b1b4-3a276a07cf44 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:42.899389 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-41e8f6fe-c4ea-4bc9-b1b4-3a276a07cf44 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:42.906816 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-41e8f6fe-c4ea-4bc9-b1b4-3a276a07cf44 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:42.907349 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-41e8f6fe-c4ea-4bc9-b1b4-3a276a07cf44 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:42.908139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-41e8f6fe-c4ea-4bc9-b1b4-3a276a07cf44 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:42.908574 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-41e8f6fe-c4ea-4bc9-b1b4-3a276a07cf44 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:43.055831 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-41e8f6fe-c4ea-4bc9-b1b4-3a276a07cf44 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:43.064330 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-41e8f6fe-c4ea-4bc9-b1b4-3a276a07cf44 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1557 microversion: 2.1 time: 0.170463 May 19 12:25:43.064925 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 118/261] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:42 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1557 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:43.082062 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4dec147a-f050-4414-b363-670d5cb520b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:43.082580 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4dec147a-f050-4414-b363-670d5cb520b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:43.085366 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=8 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:43.091672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4dec147a-f050-4414-b363-670d5cb520b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:43.092183 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4dec147a-f050-4414-b363-670d5cb520b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:43.093498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4dec147a-f050-4414-b363-670d5cb520b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:43.095158 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4dec147a-f050-4414-b363-670d5cb520b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:43.192252 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4dec147a-f050-4414-b363-670d5cb520b4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114677 May 19 12:25:43.192855 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 144/262] 10.222.0.57 () {58 vars in 1274 bytes} [Thu May 19 12:25:43 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:43.595587 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-89493538-1a43-42d4-b21a-6fb0dc79b6db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:43.596367 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-89493538-1a43-42d4-b21a-6fb0dc79b6db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:43.606220 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89493538-1a43-42d4-b21a-6fb0dc79b6db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:43.606842 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89493538-1a43-42d4-b21a-6fb0dc79b6db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:43.607882 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89493538-1a43-42d4-b21a-6fb0dc79b6db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:43.609934 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89493538-1a43-42d4-b21a-6fb0dc79b6db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:43.751493 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e4d59764-289a-4dac-9771-d9ca208ed5c6 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:43.752334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e4d59764-289a-4dac-9771-d9ca208ed5c6 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:43.759617 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e4d59764-289a-4dac-9771-d9ca208ed5c6 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:43.760060 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e4d59764-289a-4dac-9771-d9ca208ed5c6 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:43.760979 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e4d59764-289a-4dac-9771-d9ca208ed5c6 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:43.761405 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e4d59764-289a-4dac-9771-d9ca208ed5c6 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:44.277011 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-89493538-1a43-42d4-b21a-6fb0dc79b6db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:44.294638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e4d59764-289a-4dac-9771-d9ca208ed5c6 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:44.297474 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-89493538-1a43-42d4-b21a-6fb0dc79b6db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.708448 May 19 12:25:44.305744 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e4d59764-289a-4dac-9771-d9ca208ed5c6 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1314 microversion: 2.1 time: 0.560247 May 19 12:25:44.306865 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 145/263] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:43 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:44.310729 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 119/264] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:43 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:45.036054 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-7c9eab3e-7e7b-47ae-8332-74b8c8245419 req-ae915f56-f084-4f8f-8d55-b9185a070f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba02619-c806-4c69-bef7-857d2fc19405", "tag": "6e55cf88-9446-44e0-ba62-600e8724a7ee"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:45.044944 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-7c9eab3e-7e7b-47ae-8332-74b8c8245419 req-ae915f56-f084-4f8f-8d55-b9185a070f66 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:45.045652 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-7c9eab3e-7e7b-47ae-8332-74b8c8245419 req-ae915f56-f084-4f8f-8d55-b9185a070f66 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:45.060203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-7c9eab3e-7e7b-47ae-8332-74b8c8245419 req-ae915f56-f084-4f8f-8d55-b9185a070f66 service nova] Creating event network-changed:6e55cf88-9446-44e0-ba62-600e8724a7ee for instance 0ba02619-c806-4c69-bef7-857d2fc19405 on hv-cinder-77819 May 19 12:25:45.066285 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-7c9eab3e-7e7b-47ae-8332-74b8c8245419 req-ae915f56-f084-4f8f-8d55-b9185a070f66 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040411 May 19 12:25:45.067314 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 146/265] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:45.325429 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-df0541a6-7590-429a-bdf5-799085a98002 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:45.325984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-df0541a6-7590-429a-bdf5-799085a98002 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:45.330822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-86a71863-5bab-47ee-a8ad-bb351c9ee89d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:45.331511 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-86a71863-5bab-47ee-a8ad-bb351c9ee89d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:45.333096 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-df0541a6-7590-429a-bdf5-799085a98002 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:45.333700 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-df0541a6-7590-429a-bdf5-799085a98002 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:45.334719 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-df0541a6-7590-429a-bdf5-799085a98002 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:45.335864 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-df0541a6-7590-429a-bdf5-799085a98002 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:45.338358 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-86a71863-5bab-47ee-a8ad-bb351c9ee89d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:45.338841 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-86a71863-5bab-47ee-a8ad-bb351c9ee89d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:45.339615 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-86a71863-5bab-47ee-a8ad-bb351c9ee89d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:45.340213 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-86a71863-5bab-47ee-a8ad-bb351c9ee89d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:45.551751 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-86a71863-5bab-47ee-a8ad-bb351c9ee89d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:45.560799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-86a71863-5bab-47ee-a8ad-bb351c9ee89d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1314 microversion: 2.1 time: 0.240751 May 19 12:25:45.564356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 147/266] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:45 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:45.583212 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-df0541a6-7590-429a-bdf5-799085a98002 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:45.591690 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-df0541a6-7590-429a-bdf5-799085a98002 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.278085 May 19 12:25:45.592541 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 120/267] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:45 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:46.587292 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-74aed865-ce02-4f74-9070-5c7561801799 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:46.588367 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-74aed865-ce02-4f74-9070-5c7561801799 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:46.598870 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-74aed865-ce02-4f74-9070-5c7561801799 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:46.599754 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-74aed865-ce02-4f74-9070-5c7561801799 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:46.601138 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-74aed865-ce02-4f74-9070-5c7561801799 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:46.601888 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-74aed865-ce02-4f74-9070-5c7561801799 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:46.618379 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-08aea4e9-87b7-439b-9806-aec33f9c190a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:46.619222 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-08aea4e9-87b7-439b-9806-aec33f9c190a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:46.626610 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-08aea4e9-87b7-439b-9806-aec33f9c190a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:46.627324 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-08aea4e9-87b7-439b-9806-aec33f9c190a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:46.628309 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-08aea4e9-87b7-439b-9806-aec33f9c190a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:46.628834 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-08aea4e9-87b7-439b-9806-aec33f9c190a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:46.838504 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-74aed865-ce02-4f74-9070-5c7561801799 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:46.846602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-08aea4e9-87b7-439b-9806-aec33f9c190a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:46.849072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-74aed865-ce02-4f74-9070-5c7561801799 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1314 microversion: 2.1 time: 0.270986 May 19 12:25:46.849925 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 148/268] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:46 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:46.869885 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-08aea4e9-87b7-439b-9806-aec33f9c190a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.255817 May 19 12:25:46.871039 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 121/269] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:46 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:47.867761 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8a68b35f-5037-453b-a3f3-ca9a03091b4b tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:47.868476 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8a68b35f-5037-453b-a3f3-ca9a03091b4b tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:47.875312 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8a68b35f-5037-453b-a3f3-ca9a03091b4b tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:47.875760 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8a68b35f-5037-453b-a3f3-ca9a03091b4b tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:47.876617 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8a68b35f-5037-453b-a3f3-ca9a03091b4b tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:47.877057 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8a68b35f-5037-453b-a3f3-ca9a03091b4b tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:47.894728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:47.895966 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6a182546-6250-4d32-95cf-dd2b2653aef0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:47.896674 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6a182546-6250-4d32-95cf-dd2b2653aef0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:47.919225 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6a182546-6250-4d32-95cf-dd2b2653aef0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:47.920047 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6a182546-6250-4d32-95cf-dd2b2653aef0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:47.921477 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6a182546-6250-4d32-95cf-dd2b2653aef0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:47.922019 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6a182546-6250-4d32-95cf-dd2b2653aef0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:48.350523 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8a68b35f-5037-453b-a3f3-ca9a03091b4b tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:48.362073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6a182546-6250-4d32-95cf-dd2b2653aef0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:48.362357 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8a68b35f-5037-453b-a3f3-ca9a03091b4b tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1314 microversion: 2.1 time: 0.498363 May 19 12:25:48.363214 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 149/270] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:47 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:48.370649 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6a182546-6250-4d32-95cf-dd2b2653aef0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.479593 May 19 12:25:48.372619 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 122/271] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:47 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:49.378978 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-816a72ce-f1e8-4acb-bd3f-8ae3ef70f10c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:49.379590 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-816a72ce-f1e8-4acb-bd3f-8ae3ef70f10c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:49.389363 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5e84fb84-8611-4f5a-85dd-578d4b6c1de2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:49.390630 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5e84fb84-8611-4f5a-85dd-578d4b6c1de2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:49.398221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-816a72ce-f1e8-4acb-bd3f-8ae3ef70f10c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:49.398627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-816a72ce-f1e8-4acb-bd3f-8ae3ef70f10c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:49.399413 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-816a72ce-f1e8-4acb-bd3f-8ae3ef70f10c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:49.399524 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5e84fb84-8611-4f5a-85dd-578d4b6c1de2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:49.399849 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-816a72ce-f1e8-4acb-bd3f-8ae3ef70f10c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:49.400206 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5e84fb84-8611-4f5a-85dd-578d4b6c1de2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:49.402342 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5e84fb84-8611-4f5a-85dd-578d4b6c1de2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:49.402342 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5e84fb84-8611-4f5a-85dd-578d4b6c1de2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:49.639056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-816a72ce-f1e8-4acb-bd3f-8ae3ef70f10c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:49.648881 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-816a72ce-f1e8-4acb-bd3f-8ae3ef70f10c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1314 microversion: 2.1 time: 0.273479 May 19 12:25:49.651228 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 150/272] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:49 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:49.654629 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5e84fb84-8611-4f5a-85dd-578d4b6c1de2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:49.666353 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5e84fb84-8611-4f5a-85dd-578d4b6c1de2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.280844 May 19 12:25:49.682812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 123/273] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:49 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:49.973659 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-66970c71-ca80-4391-b6b4-b154fcdc8e49 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:49.977496 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-66970c71-ca80-4391-b6b4-b154fcdc8e49 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:49.985207 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-66970c71-ca80-4391-b6b4-b154fcdc8e49 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:49.985828 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-66970c71-ca80-4391-b6b4-b154fcdc8e49 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:49.986648 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-66970c71-ca80-4391-b6b4-b154fcdc8e49 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:49.987085 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-66970c71-ca80-4391-b6b4-b154fcdc8e49 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:50.032791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-66970c71-ca80-4391-b6b4-b154fcdc8e49 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Going to try to terminate instance {{(pid=118112) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:25:50.518475 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-66970c71-ca80-4391-b6b4-b154fcdc8e49 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "DELETE /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 204 len: 0 microversion: 2.1 time: 0.551524 May 19 12:25:50.519825 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 151/274] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:25:49 2022] DELETE /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 0 bytes in 554 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:25:50.532476 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c4c9ab9d-a84f-438b-8a9b-b71aa93223a2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:50.533567 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c4c9ab9d-a84f-438b-8a9b-b71aa93223a2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:50.544255 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4c9ab9d-a84f-438b-8a9b-b71aa93223a2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:50.544970 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4c9ab9d-a84f-438b-8a9b-b71aa93223a2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:50.546303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4c9ab9d-a84f-438b-8a9b-b71aa93223a2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:50.547115 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4c9ab9d-a84f-438b-8a9b-b71aa93223a2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:50.669064 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-18a7f6bf-5329-45a9-bbc3-b54eb91be4cc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:50.669882 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-18a7f6bf-5329-45a9-bbc3-b54eb91be4cc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:50.678365 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-18a7f6bf-5329-45a9-bbc3-b54eb91be4cc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:50.678978 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-18a7f6bf-5329-45a9-bbc3-b54eb91be4cc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:50.679883 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-18a7f6bf-5329-45a9-bbc3-b54eb91be4cc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:50.680479 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-18a7f6bf-5329-45a9-bbc3-b54eb91be4cc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:50.775859 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c4c9ab9d-a84f-438b-8a9b-b71aa93223a2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:50.802870 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c4c9ab9d-a84f-438b-8a9b-b71aa93223a2 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1553 microversion: 2.1 time: 0.277768 May 19 12:25:50.803858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 124/275] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:50 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1553 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:50.813222 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c90ded61-f1b1-49fe-afe0-446bbb7822e7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:50.814946 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c90ded61-f1b1-49fe-afe0-446bbb7822e7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:50.822891 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c90ded61-f1b1-49fe-afe0-446bbb7822e7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:50.823881 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c90ded61-f1b1-49fe-afe0-446bbb7822e7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:50.824888 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c90ded61-f1b1-49fe-afe0-446bbb7822e7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:50.825548 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c90ded61-f1b1-49fe-afe0-446bbb7822e7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:50.942558 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-18a7f6bf-5329-45a9-bbc3-b54eb91be4cc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:50.950870 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-18a7f6bf-5329-45a9-bbc3-b54eb91be4cc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1314 microversion: 2.1 time: 0.286185 May 19 12:25:50.954506 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 152/276] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:50 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:50.956668 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-90b01b35-f180-412e-93fa-fc21ed2a168c req-914a100c-5aec-439b-8804-98c447419948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82eb59af-b07c-4b0a-9a14-596ee9d70b44", "name": "network-vif-plugged", "status": "completed", "tag": "798a721b-76d2-4afc-a9c4-c752be3ca25f"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:50.960310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:50.966947 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-90b01b35-f180-412e-93fa-fc21ed2a168c req-914a100c-5aec-439b-8804-98c447419948 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:50.967394 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-90b01b35-f180-412e-93fa-fc21ed2a168c req-914a100c-5aec-439b-8804-98c447419948 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:50.980594 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-90b01b35-f180-412e-93fa-fc21ed2a168c req-914a100c-5aec-439b-8804-98c447419948 service nova] Creating event network-vif-plugged:798a721b-76d2-4afc-a9c4-c752be3ca25f for instance 82eb59af-b07c-4b0a-9a14-596ee9d70b44 on hv-cinder-77819 May 19 12:25:50.987708 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-90b01b35-f180-412e-93fa-fc21ed2a168c req-914a100c-5aec-439b-8804-98c447419948 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034682 May 19 12:25:50.988952 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 153/277] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:51.010878 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c90ded61-f1b1-49fe-afe0-446bbb7822e7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:51.020524 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c90ded61-f1b1-49fe-afe0-446bbb7822e7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.214907 May 19 12:25:51.021140 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 125/278] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:50 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:51.822311 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-78c586b1-0519-462b-b10b-80e7d96e7533 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:51.823023 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-78c586b1-0519-462b-b10b-80e7d96e7533 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:51.829502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78c586b1-0519-462b-b10b-80e7d96e7533 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:51.829946 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78c586b1-0519-462b-b10b-80e7d96e7533 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:51.830739 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78c586b1-0519-462b-b10b-80e7d96e7533 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:51.831174 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78c586b1-0519-462b-b10b-80e7d96e7533 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:51.980644 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b128b4b4-18fa-453e-8fe6-c1205268e330 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:51.981408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-78c586b1-0519-462b-b10b-80e7d96e7533 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:51.986064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b128b4b4-18fa-453e-8fe6-c1205268e330 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:51.991017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-78c586b1-0519-462b-b10b-80e7d96e7533 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1553 microversion: 2.1 time: 0.173175 May 19 12:25:51.994547 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b128b4b4-18fa-453e-8fe6-c1205268e330 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:51.995346 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b128b4b4-18fa-453e-8fe6-c1205268e330 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:51.996729 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b128b4b4-18fa-453e-8fe6-c1205268e330 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:51.997500 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b128b4b4-18fa-453e-8fe6-c1205268e330 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:51.999851 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 154/279] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:51 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:52.044140 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ad0716e1-04a4-4682-94b7-73662ce78e9c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:52.045286 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ad0716e1-04a4-4682-94b7-73662ce78e9c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:52.057429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ad0716e1-04a4-4682-94b7-73662ce78e9c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:52.058132 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ad0716e1-04a4-4682-94b7-73662ce78e9c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:52.059029 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ad0716e1-04a4-4682-94b7-73662ce78e9c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:52.061339 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ad0716e1-04a4-4682-94b7-73662ce78e9c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:52.232103 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b128b4b4-18fa-453e-8fe6-c1205268e330 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:52.241147 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b128b4b4-18fa-453e-8fe6-c1205268e330 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1314 microversion: 2.1 time: 0.274919 May 19 12:25:52.241964 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 126/280] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:51 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:52.257969 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ad0716e1-04a4-4682-94b7-73662ce78e9c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:52.265578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ad0716e1-04a4-4682-94b7-73662ce78e9c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.225585 May 19 12:25:52.266044 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 155/281] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:52 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:53.007314 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4a88ef65-0e88-4414-ac97-9f673a3a500d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:53.007924 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4a88ef65-0e88-4414-ac97-9f673a3a500d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:53.015318 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a88ef65-0e88-4414-ac97-9f673a3a500d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:53.015828 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a88ef65-0e88-4414-ac97-9f673a3a500d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:53.016646 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a88ef65-0e88-4414-ac97-9f673a3a500d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:53.017079 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a88ef65-0e88-4414-ac97-9f673a3a500d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:53.181063 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4a88ef65-0e88-4414-ac97-9f673a3a500d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:53.191405 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4a88ef65-0e88-4414-ac97-9f673a3a500d tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1553 microversion: 2.1 time: 0.188187 May 19 12:25:53.191996 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 127/282] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:53 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:53.265144 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0432247a-45fc-4253-abdb-98c290523e12 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:53.266147 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0432247a-45fc-4253-abdb-98c290523e12 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:53.278238 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0432247a-45fc-4253-abdb-98c290523e12 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:53.278238 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0432247a-45fc-4253-abdb-98c290523e12 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:53.279598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0432247a-45fc-4253-abdb-98c290523e12 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:53.279598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0432247a-45fc-4253-abdb-98c290523e12 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:53.289148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e5e3a5e2-c91b-4f8b-8a42-d50c3543ef9b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:53.289827 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e5e3a5e2-c91b-4f8b-8a42-d50c3543ef9b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:53.307125 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e5e3a5e2-c91b-4f8b-8a42-d50c3543ef9b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:53.307924 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e5e3a5e2-c91b-4f8b-8a42-d50c3543ef9b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:53.309641 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e5e3a5e2-c91b-4f8b-8a42-d50c3543ef9b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:53.310453 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e5e3a5e2-c91b-4f8b-8a42-d50c3543ef9b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:53.552654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0432247a-45fc-4253-abdb-98c290523e12 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:53.553107 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e5e3a5e2-c91b-4f8b-8a42-d50c3543ef9b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:53.561828 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e5e3a5e2-c91b-4f8b-8a42-d50c3543ef9b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.281967 May 19 12:25:53.571634 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 128/283] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:53 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:53.572306 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0432247a-45fc-4253-abdb-98c290523e12 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1314 microversion: 2.1 time: 0.313900 May 19 12:25:53.572533 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 156/284] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:53 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:54.209671 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-60093e44-72d1-4704-aa54-bbb57d18b0e0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:54.210358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-60093e44-72d1-4704-aa54-bbb57d18b0e0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:54.217281 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-60093e44-72d1-4704-aa54-bbb57d18b0e0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:54.218140 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-60093e44-72d1-4704-aa54-bbb57d18b0e0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:54.219110 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-60093e44-72d1-4704-aa54-bbb57d18b0e0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:54.219727 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-60093e44-72d1-4704-aa54-bbb57d18b0e0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:54.374577 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-60093e44-72d1-4704-aa54-bbb57d18b0e0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:54.383911 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-60093e44-72d1-4704-aa54-bbb57d18b0e0 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1553 microversion: 2.1 time: 0.179022 May 19 12:25:54.384507 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 129/285] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:54 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1553 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:54.579914 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9ab06e25-3e58-4357-b159-b612cbe7c3a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:54.580677 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9ab06e25-3e58-4357-b159-b612cbe7c3a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:54.588084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9ab06e25-3e58-4357-b159-b612cbe7c3a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:54.588836 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9ab06e25-3e58-4357-b159-b612cbe7c3a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:54.589454 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ea1ad4d6-e4c7-491e-92f9-7f36a767da97 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:54.589606 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9ab06e25-3e58-4357-b159-b612cbe7c3a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:54.590041 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9ab06e25-3e58-4357-b159-b612cbe7c3a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:54.590429 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ea1ad4d6-e4c7-491e-92f9-7f36a767da97 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:54.599806 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea1ad4d6-e4c7-491e-92f9-7f36a767da97 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:54.601927 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea1ad4d6-e4c7-491e-92f9-7f36a767da97 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:54.602964 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea1ad4d6-e4c7-491e-92f9-7f36a767da97 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:54.603670 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea1ad4d6-e4c7-491e-92f9-7f36a767da97 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:54.817876 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9ab06e25-3e58-4357-b159-b612cbe7c3a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:54.831616 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9ab06e25-3e58-4357-b159-b612cbe7c3a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.255874 May 19 12:25:54.832208 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 157/286] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:54 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:54.876709 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ea1ad4d6-e4c7-491e-92f9-7f36a767da97 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:54.885545 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ea1ad4d6-e4c7-491e-92f9-7f36a767da97 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1314 microversion: 2.1 time: 0.300160 May 19 12:25:54.886140 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 130/287] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:54 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:55.340213 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-934547ea-1ba9-45b6-98a0-21bbbc44f740 req-21965eb2-c5da-4117-b628-3dbc37de207d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29fc59e9-f88a-46c9-a0d8-c695f778541e", "name": "network-vif-deleted", "tag": "82ec4d27-e4be-404b-a6d9-8404077c5070"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:25:55.350531 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-934547ea-1ba9-45b6-98a0-21bbbc44f740 req-21965eb2-c5da-4117-b628-3dbc37de207d service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:55.350988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-934547ea-1ba9-45b6-98a0-21bbbc44f740 req-21965eb2-c5da-4117-b628-3dbc37de207d service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:55.366315 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-934547ea-1ba9-45b6-98a0-21bbbc44f740 req-21965eb2-c5da-4117-b628-3dbc37de207d service nova] Creating event network-vif-deleted:82ec4d27-e4be-404b-a6d9-8404077c5070 for instance 29fc59e9-f88a-46c9-a0d8-c695f778541e on hv-cinder-77819 May 19 12:25:55.375754 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-934547ea-1ba9-45b6-98a0-21bbbc44f740 req-21965eb2-c5da-4117-b628-3dbc37de207d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039153 May 19 12:25:55.377578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 158/288] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:25:55.410612 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-46ce3a89-8392-4a62-ae46-c15d16f3e67b tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:55.411677 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-46ce3a89-8392-4a62-ae46-c15d16f3e67b tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:55.419049 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46ce3a89-8392-4a62-ae46-c15d16f3e67b tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:55.419485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46ce3a89-8392-4a62-ae46-c15d16f3e67b tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:55.426688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46ce3a89-8392-4a62-ae46-c15d16f3e67b tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:55.426688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46ce3a89-8392-4a62-ae46-c15d16f3e67b tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:55.507830 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-46ce3a89-8392-4a62-ae46-c15d16f3e67b tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:55.522734 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-46ce3a89-8392-4a62-ae46-c15d16f3e67b tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1511 microversion: 2.1 time: 0.118131 May 19 12:25:55.523786 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 131/289] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:55 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1511 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:55.850777 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4910cbec-c7d2-4aa6-8881-42f41583f263 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:55.851443 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4910cbec-c7d2-4aa6-8881-42f41583f263 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:55.859665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4910cbec-c7d2-4aa6-8881-42f41583f263 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:55.860028 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4910cbec-c7d2-4aa6-8881-42f41583f263 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:55.860921 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4910cbec-c7d2-4aa6-8881-42f41583f263 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:55.861545 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4910cbec-c7d2-4aa6-8881-42f41583f263 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:55.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-35133410-55b4-4f2e-bdd8-c30748fd8d6c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:55.905301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-35133410-55b4-4f2e-bdd8-c30748fd8d6c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:55.912937 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-35133410-55b4-4f2e-bdd8-c30748fd8d6c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:55.913385 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-35133410-55b4-4f2e-bdd8-c30748fd8d6c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:55.914223 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-35133410-55b4-4f2e-bdd8-c30748fd8d6c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:55.914702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-35133410-55b4-4f2e-bdd8-c30748fd8d6c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:55.935415 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:25:56.160095 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4910cbec-c7d2-4aa6-8881-42f41583f263 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:56.165839 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-35133410-55b4-4f2e-bdd8-c30748fd8d6c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:56.174320 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-35133410-55b4-4f2e-bdd8-c30748fd8d6c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1314 microversion: 2.1 time: 0.274636 May 19 12:25:56.175999 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4910cbec-c7d2-4aa6-8881-42f41583f263 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.329113 May 19 12:25:56.176972 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 159/290] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:55 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:56.194468 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 132/291] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:55 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:56.542730 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-071e4278-bc43-44a1-8254-2f8202f1c5dd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:56.543389 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-071e4278-bc43-44a1-8254-2f8202f1c5dd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:56.550344 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-071e4278-bc43-44a1-8254-2f8202f1c5dd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:56.550860 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-071e4278-bc43-44a1-8254-2f8202f1c5dd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:56.551644 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-071e4278-bc43-44a1-8254-2f8202f1c5dd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:56.552076 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-071e4278-bc43-44a1-8254-2f8202f1c5dd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:56.639182 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-071e4278-bc43-44a1-8254-2f8202f1c5dd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:56.652924 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-071e4278-bc43-44a1-8254-2f8202f1c5dd tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1346 microversion: 2.1 time: 0.113713 May 19 12:25:56.654219 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 160/292] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:56 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1346 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:57.201316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-72c5d85b-9fe4-4c8f-ab5b-8106183f5cf4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:57.202400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f75b9c25-9ed4-47fc-9583-faf279c06ff7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:57.203099 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-72c5d85b-9fe4-4c8f-ab5b-8106183f5cf4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:57.204477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f75b9c25-9ed4-47fc-9583-faf279c06ff7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:57.214483 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f75b9c25-9ed4-47fc-9583-faf279c06ff7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:57.215715 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f75b9c25-9ed4-47fc-9583-faf279c06ff7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:57.216534 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f75b9c25-9ed4-47fc-9583-faf279c06ff7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:57.216938 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-72c5d85b-9fe4-4c8f-ab5b-8106183f5cf4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:57.218042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f75b9c25-9ed4-47fc-9583-faf279c06ff7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:57.218990 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-72c5d85b-9fe4-4c8f-ab5b-8106183f5cf4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:57.219884 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-72c5d85b-9fe4-4c8f-ab5b-8106183f5cf4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:57.220407 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-72c5d85b-9fe4-4c8f-ab5b-8106183f5cf4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:57.468618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f75b9c25-9ed4-47fc-9583-faf279c06ff7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:57.492183 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-72c5d85b-9fe4-4c8f-ab5b-8106183f5cf4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:57.495513 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f75b9c25-9ed4-47fc-9583-faf279c06ff7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.298414 May 19 12:25:57.505296 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-72c5d85b-9fe4-4c8f-ab5b-8106183f5cf4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1497 microversion: 2.1 time: 0.308911 May 19 12:25:57.509163 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 161/293] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:57 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:57.516408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 133/294] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:57 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1497 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:25:57.671786 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-488bc3ce-7fb4-4cb4-9ccd-fb1cec731487 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:57.672418 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-488bc3ce-7fb4-4cb4-9ccd-fb1cec731487 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:57.679322 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-488bc3ce-7fb4-4cb4-9ccd-fb1cec731487 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:57.679778 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-488bc3ce-7fb4-4cb4-9ccd-fb1cec731487 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:57.680573 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-488bc3ce-7fb4-4cb4-9ccd-fb1cec731487 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:57.681008 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-488bc3ce-7fb4-4cb4-9ccd-fb1cec731487 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:57.726991 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-488bc3ce-7fb4-4cb4-9ccd-fb1cec731487 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:57.726991 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-488bc3ce-7fb4-4cb4-9ccd-fb1cec731487 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:57.726991 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-488bc3ce-7fb4-4cb4-9ccd-fb1cec731487 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lazy-loading 'fault' on Instance uuid 29fc59e9-f88a-46c9-a0d8-c695f778541e {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:25:57.781188 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-488bc3ce-7fb4-4cb4-9ccd-fb1cec731487 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bcf2df379a44e4bb05c21c495c38483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99c98b6b528545f7a18638d5a0f69bb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:57.789959 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-488bc3ce-7fb4-4cb4-9ccd-fb1cec731487 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 200 len: 1351 microversion: 2.1 time: 0.122421 May 19 12:25:57.790556 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 162/295] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:57 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 1351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:58.528230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ad98c78f-1b21-4107-b5e4-c603c643cec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:58.529259 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ad98c78f-1b21-4107-b5e4-c603c643cec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:58.538757 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad98c78f-1b21-4107-b5e4-c603c643cec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:58.539213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad98c78f-1b21-4107-b5e4-c603c643cec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:58.540352 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad98c78f-1b21-4107-b5e4-c603c643cec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:58.541195 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad98c78f-1b21-4107-b5e4-c603c643cec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:58.761228 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ad98c78f-1b21-4107-b5e4-c603c643cec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:58.767388 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ad98c78f-1b21-4107-b5e4-c603c643cec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.244409 May 19 12:25:58.767987 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 134/296] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:58 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:58.810961 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-039848c1-2d55-4999-b231-acbf6c82c140 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:58.813080 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-039848c1-2d55-4999-b231-acbf6c82c140 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:58.824397 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-039848c1-2d55-4999-b231-acbf6c82c140 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:58.825522 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-039848c1-2d55-4999-b231-acbf6c82c140 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:58.826512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-40ff0dfa-6087-47d8-9ec8-247d755dd61e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:58.827562 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-039848c1-2d55-4999-b231-acbf6c82c140 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:58.827683 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-40ff0dfa-6087-47d8-9ec8-247d755dd61e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:58.828268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-039848c1-2d55-4999-b231-acbf6c82c140 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:58.834005 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40ff0dfa-6087-47d8-9ec8-247d755dd61e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:58.834509 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40ff0dfa-6087-47d8-9ec8-247d755dd61e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:58.835303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40ff0dfa-6087-47d8-9ec8-247d755dd61e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:58.835738 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40ff0dfa-6087-47d8-9ec8-247d755dd61e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:58.844545 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-039848c1-2d55-4999-b231-acbf6c82c140 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] HTTP exception thrown: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-039848c1-2d55-4999-b231-acbf6c82c140 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Request method failure captured: May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e HTTP/1.1 May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjbu8mqTLaSmEI0CKBlZQMJya4bsXk_7zrOLIQSuSsWqy4HVcrn9rqTbhC0wZx7z1UsBrzwWnoYd2H8UnpxkYK5JrLox-HyM5u2-S-q44be6iEezLhrGUklHXLflhiVSBU-uLeWXpK3Ly1X4D7GnYkVtTxQfU4TyCQGQFG69EEnv7_M May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 99c98b6b528545f7a18638d5a0f69bb4 May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-DeleteServersTestJSON-487682689 May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:25:58.849682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:25:58.851307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/99c98b6b528545f7a18638d5a0f69bb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/99c98b6b528545f7a18638d5a0f69bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/99c98b6b528545f7a18638d5a0f69bb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_99c98b6b528545f7a18638d5a0f69bb4", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:25:58.851307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-DeleteServersTestJSON-487682689 May 19 12:25:58.851307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 99c98b6b528545f7a18638d5a0f69bb4 May 19 12:25:58.851307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-DeleteServersTestJSON-487682689 May 19 12:25:58.851307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-DeleteServersTestJSON-487682689-project May 19 12:25:58.851307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:25:58.851307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:25:58.851307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 0bcf2df379a44e4bb05c21c495c38483 May 19 12:25:58.851307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-DeleteServersTestJSON-487682689-project May 19 12:25:58.851307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:25:58.851307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:25:58.851307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '29fc59e9-f88a-46c9-a0d8-c695f778541e'} May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:25:58.852110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:25:58.853464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:25:58.854573 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-039848c1-2d55-4999-b231-acbf6c82c140 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Returning 404 to user: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:25:58.854573 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-039848c1-2d55-4999-b231-acbf6c82c140 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 404 len: 111 microversion: 2.1 time: 0.045590 May 19 12:25:58.855212 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 163/297] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:58 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:25:58.872067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-40ff0dfa-6087-47d8-9ec8-247d755dd61e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:25:58.999761 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fd682079-3b64-429b-aeb6-8ab853dc3366 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:59.000860 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fd682079-3b64-429b-aeb6-8ab853dc3366 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:59.008447 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd682079-3b64-429b-aeb6-8ab853dc3366 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:59.008898 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd682079-3b64-429b-aeb6-8ab853dc3366 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:59.009677 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd682079-3b64-429b-aeb6-8ab853dc3366 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:59.010109 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd682079-3b64-429b-aeb6-8ab853dc3366 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:59.031693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-fd682079-3b64-429b-aeb6-8ab853dc3366 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] HTTP exception thrown: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fd682079-3b64-429b-aeb6-8ab853dc3366 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Request method failure captured: May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e/os-volume_attachments HTTP/1.1 May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjbu8mqTLaSmEI0CKBlZQMJya4bsXk_7zrOLIQSuSsWqy4HVcrn9rqTbhC0wZx7z1UsBrzwWnoYd2H8UnpxkYK5JrLox-HyM5u2-S-q44be6iEezLhrGUklHXLflhiVSBU-uLeWXpK3Ly1X4D7GnYkVtTxQfU4TyCQGQFG69EEnv7_M May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 99c98b6b528545f7a18638d5a0f69bb4 May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-DeleteServersTestJSON-487682689 May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:25:59.033955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:25:59.035373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/99c98b6b528545f7a18638d5a0f69bb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/99c98b6b528545f7a18638d5a0f69bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/99c98b6b528545f7a18638d5a0f69bb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_99c98b6b528545f7a18638d5a0f69bb4", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:25:59.035373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-DeleteServersTestJSON-487682689 May 19 12:25:59.035373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 99c98b6b528545f7a18638d5a0f69bb4 May 19 12:25:59.035373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-DeleteServersTestJSON-487682689 May 19 12:25:59.035373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-DeleteServersTestJSON-487682689-project May 19 12:25:59.035373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:25:59.035373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:25:59.035373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 0bcf2df379a44e4bb05c21c495c38483 May 19 12:25:59.035373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-DeleteServersTestJSON-487682689-project May 19 12:25:59.035373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:25:59.035373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:25:59.035373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'server_id': '29fc59e9-f88a-46c9-a0d8-c695f778541e'} May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:25:59.036145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:25:59.037310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:25:59.038681 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fd682079-3b64-429b-aeb6-8ab853dc3366 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Returning 404 to user: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:25:59.038681 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fd682079-3b64-429b-aeb6-8ab853dc3366 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040805 May 19 12:25:59.038681 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 164/298] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:25:58 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:25:59.384076 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-40ff0dfa-6087-47d8-9ec8-247d755dd61e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "DELETE /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 204 len: 0 microversion: 2.1 time: 0.560069 May 19 12:25:59.386532 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 135/299] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:25:58 2022] DELETE /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 12:25:59.395240 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5d80f343-86ce-4fba-81cc-6a2fb22579eb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:59.396074 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5d80f343-86ce-4fba-81cc-6a2fb22579eb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:59.404096 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5d80f343-86ce-4fba-81cc-6a2fb22579eb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:59.404695 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5d80f343-86ce-4fba-81cc-6a2fb22579eb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:59.405665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5d80f343-86ce-4fba-81cc-6a2fb22579eb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:59.406321 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5d80f343-86ce-4fba-81cc-6a2fb22579eb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:59.591873 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5d80f343-86ce-4fba-81cc-6a2fb22579eb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:25:59.607078 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5d80f343-86ce-4fba-81cc-6a2fb22579eb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1503 microversion: 2.1 time: 0.215493 May 19 12:25:59.608789 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 165/300] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:59 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1503 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:25:59.799496 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5d41a29c-920b-4e30-bf95-9d4bf69d736c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:25:59.801256 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5d41a29c-920b-4e30-bf95-9d4bf69d736c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:25:59.815031 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d41a29c-920b-4e30-bf95-9d4bf69d736c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:59.815822 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d41a29c-920b-4e30-bf95-9d4bf69d736c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:25:59.817427 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d41a29c-920b-4e30-bf95-9d4bf69d736c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:25:59.818225 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d41a29c-920b-4e30-bf95-9d4bf69d736c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:00.089728 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5d41a29c-920b-4e30-bf95-9d4bf69d736c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:00.099013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5d41a29c-920b-4e30-bf95-9d4bf69d736c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.309079 May 19 12:26:00.099582 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 136/301] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:25:59 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:00.481367 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-048ef756-8ba9-4a92-a62e-84a6437c6890 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:00.482204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-048ef756-8ba9-4a92-a62e-84a6437c6890 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:00.490656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-048ef756-8ba9-4a92-a62e-84a6437c6890 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:00.494956 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-048ef756-8ba9-4a92-a62e-84a6437c6890 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:00.494956 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-048ef756-8ba9-4a92-a62e-84a6437c6890 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:00.494956 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-048ef756-8ba9-4a92-a62e-84a6437c6890 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:00.512566 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-048ef756-8ba9-4a92-a62e-84a6437c6890 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] HTTP exception thrown: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-048ef756-8ba9-4a92-a62e-84a6437c6890 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Request method failure captured: May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: DELETE /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e HTTP/1.1 May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjbu8mqTLaSmEI0CKBlZQMJya4bsXk_7zrOLIQSuSsWqy4HVcrn9rqTbhC0wZx7z1UsBrzwWnoYd2H8UnpxkYK5JrLox-HyM5u2-S-q44be6iEezLhrGUklHXLflhiVSBU-uLeWXpK3Ly1X4D7GnYkVtTxQfU4TyCQGQFG69EEnv7_M May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 99c98b6b528545f7a18638d5a0f69bb4 May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-DeleteServersTestJSON-487682689 May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:26:00.515273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:26:00.518017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/99c98b6b528545f7a18638d5a0f69bb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/99c98b6b528545f7a18638d5a0f69bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/99c98b6b528545f7a18638d5a0f69bb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_99c98b6b528545f7a18638d5a0f69bb4", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:26:00.518017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-DeleteServersTestJSON-487682689 May 19 12:26:00.518017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 99c98b6b528545f7a18638d5a0f69bb4 May 19 12:26:00.518017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-DeleteServersTestJSON-487682689 May 19 12:26:00.518017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-DeleteServersTestJSON-487682689-project May 19 12:26:00.518017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:26:00.518017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:26:00.518017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 0bcf2df379a44e4bb05c21c495c38483 May 19 12:26:00.518017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-DeleteServersTestJSON-487682689-project May 19 12:26:00.518017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:26:00.518017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:26:00.518017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '29fc59e9-f88a-46c9-a0d8-c695f778541e'} May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:26:00.531216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:26:00.532451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:26:00.533543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-048ef756-8ba9-4a92-a62e-84a6437c6890 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Returning 404 to user: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:26:00.533543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-048ef756-8ba9-4a92-a62e-84a6437c6890 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "DELETE /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 404 len: 111 microversion: 2.1 time: 0.040737 May 19 12:26:00.533543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 166/302] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:26:00 2022] DELETE /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:26:00.535602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6c356925-1f83-4870-a719-97e10266a321 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:00.536995 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6c356925-1f83-4870-a719-97e10266a321 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] [instance: 29fc59e9-f88a-46c9-a0d8-c695f778541e] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:00.548206 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6c356925-1f83-4870-a719-97e10266a321 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:00.548756 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6c356925-1f83-4870-a719-97e10266a321 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:00.554568 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6c356925-1f83-4870-a719-97e10266a321 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:00.554568 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6c356925-1f83-4870-a719-97e10266a321 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:00.567939 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-6c356925-1f83-4870-a719-97e10266a321 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] HTTP exception thrown: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6c356925-1f83-4870-a719-97e10266a321 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Request method failure captured: May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e HTTP/1.1 May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjbu8mqTLaSmEI0CKBlZQMJya4bsXk_7zrOLIQSuSsWqy4HVcrn9rqTbhC0wZx7z1UsBrzwWnoYd2H8UnpxkYK5JrLox-HyM5u2-S-q44be6iEezLhrGUklHXLflhiVSBU-uLeWXpK3Ly1X4D7GnYkVtTxQfU4TyCQGQFG69EEnv7_M May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 99c98b6b528545f7a18638d5a0f69bb4 May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-DeleteServersTestJSON-487682689 May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:26:00.573470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:26:00.575936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/99c98b6b528545f7a18638d5a0f69bb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/99c98b6b528545f7a18638d5a0f69bb4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/99c98b6b528545f7a18638d5a0f69bb4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_99c98b6b528545f7a18638d5a0f69bb4", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:26:00.575936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-DeleteServersTestJSON-487682689 May 19 12:26:00.575936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 99c98b6b528545f7a18638d5a0f69bb4 May 19 12:26:00.575936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-DeleteServersTestJSON-487682689 May 19 12:26:00.575936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-DeleteServersTestJSON-487682689-project May 19 12:26:00.575936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:26:00.575936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:26:00.575936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 0bcf2df379a44e4bb05c21c495c38483 May 19 12:26:00.575936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-DeleteServersTestJSON-487682689-project May 19 12:26:00.575936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:26:00.575936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:26:00.575936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '29fc59e9-f88a-46c9-a0d8-c695f778541e'} May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:26:00.577969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. May 19 12:26:00.580865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:00.582947 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6c356925-1f83-4870-a719-97e10266a321 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] Returning 404 to user: Instance 29fc59e9-f88a-46c9-a0d8-c695f778541e could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:26:00.582947 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6c356925-1f83-4870-a719-97e10266a321 tempest-DeleteServersTestJSON-487682689 tempest-DeleteServersTestJSON-487682689-project] 10.222.0.57 "GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e" status: 404 len: 111 microversion: 2.1 time: 0.049132 May 19 12:26:00.582947 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 137/303] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:00 2022] GET /compute/v2.1/servers/29fc59e9-f88a-46c9-a0d8-c695f778541e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:26:00.637046 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0558ef85-9872-4dfd-b9d1-76b95e3fe1f2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:00.637949 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0558ef85-9872-4dfd-b9d1-76b95e3fe1f2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:00.646477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0558ef85-9872-4dfd-b9d1-76b95e3fe1f2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:00.647351 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0558ef85-9872-4dfd-b9d1-76b95e3fe1f2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:00.648830 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0558ef85-9872-4dfd-b9d1-76b95e3fe1f2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:00.649897 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0558ef85-9872-4dfd-b9d1-76b95e3fe1f2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:00.701818 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:00.908299 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0558ef85-9872-4dfd-b9d1-76b95e3fe1f2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:00.923815 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0558ef85-9872-4dfd-b9d1-76b95e3fe1f2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1503 microversion: 2.1 time: 0.293447 May 19 12:26:00.925212 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 167/304] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:00 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1503 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:01.118776 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4e8ff3ad-dc0f-4534-9e9d-aa6f755ea88e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:01.120479 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4e8ff3ad-dc0f-4534-9e9d-aa6f755ea88e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:01.150677 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4e8ff3ad-dc0f-4534-9e9d-aa6f755ea88e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:01.151778 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4e8ff3ad-dc0f-4534-9e9d-aa6f755ea88e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:01.153462 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4e8ff3ad-dc0f-4534-9e9d-aa6f755ea88e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:01.155563 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4e8ff3ad-dc0f-4534-9e9d-aa6f755ea88e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:01.646053 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4e8ff3ad-dc0f-4534-9e9d-aa6f755ea88e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:01.661718 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4e8ff3ad-dc0f-4534-9e9d-aa6f755ea88e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.548276 May 19 12:26:01.672430 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 138/305] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:01 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:01.951019 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4f9220d0-9cc3-4f5f-b262-9e329e5ab12e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:01.952368 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4f9220d0-9cc3-4f5f-b262-9e329e5ab12e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:01.960316 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4f9220d0-9cc3-4f5f-b262-9e329e5ab12e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:01.961162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4f9220d0-9cc3-4f5f-b262-9e329e5ab12e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:01.962270 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4f9220d0-9cc3-4f5f-b262-9e329e5ab12e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:01.963058 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4f9220d0-9cc3-4f5f-b262-9e329e5ab12e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:02.202860 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4f9220d0-9cc3-4f5f-b262-9e329e5ab12e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:02.210981 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4f9220d0-9cc3-4f5f-b262-9e329e5ab12e tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1503 microversion: 2.1 time: 0.263971 May 19 12:26:02.211962 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 168/306] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:01 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:02.532603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-d5c198b1-d293-4a5d-ac46-ea1e6b1523e4 req-a2a78eb6-dff0-4aa2-aa3e-08f20fb5b11a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82eb59af-b07c-4b0a-9a14-596ee9d70b44", "name": "network-vif-deleted", "tag": "798a721b-76d2-4afc-a9c4-c752be3ca25f"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:02.542253 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-d5c198b1-d293-4a5d-ac46-ea1e6b1523e4 req-a2a78eb6-dff0-4aa2-aa3e-08f20fb5b11a service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:02.542759 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-d5c198b1-d293-4a5d-ac46-ea1e6b1523e4 req-a2a78eb6-dff0-4aa2-aa3e-08f20fb5b11a service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:02.573868 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-d5c198b1-d293-4a5d-ac46-ea1e6b1523e4 req-a2a78eb6-dff0-4aa2-aa3e-08f20fb5b11a service nova] Creating event network-vif-deleted:798a721b-76d2-4afc-a9c4-c752be3ca25f for instance 82eb59af-b07c-4b0a-9a14-596ee9d70b44 on hv-cinder-77819 May 19 12:26:02.582685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-d5c198b1-d293-4a5d-ac46-ea1e6b1523e4 req-a2a78eb6-dff0-4aa2-aa3e-08f20fb5b11a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053931 May 19 12:26:02.583745 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 139/307] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:02.681298 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4553dd00-9956-484e-a604-45f25933b237 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:02.682445 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4553dd00-9956-484e-a604-45f25933b237 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:02.691784 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4553dd00-9956-484e-a604-45f25933b237 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:02.692512 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4553dd00-9956-484e-a604-45f25933b237 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:02.693319 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4553dd00-9956-484e-a604-45f25933b237 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:02.694026 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4553dd00-9956-484e-a604-45f25933b237 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:02.878472 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4553dd00-9956-484e-a604-45f25933b237 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:02.888631 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4553dd00-9956-484e-a604-45f25933b237 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.211459 May 19 12:26:02.889795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 169/308] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:02 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:03.236601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-301177a0-2e86-4c5c-ad48-6fc7e2f9f6af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:03.237991 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-301177a0-2e86-4c5c-ad48-6fc7e2f9f6af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:03.251059 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-301177a0-2e86-4c5c-ad48-6fc7e2f9f6af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:03.251880 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-301177a0-2e86-4c5c-ad48-6fc7e2f9f6af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:03.253340 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-301177a0-2e86-4c5c-ad48-6fc7e2f9f6af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:03.254105 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-301177a0-2e86-4c5c-ad48-6fc7e2f9f6af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:03.320454 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-301177a0-2e86-4c5c-ad48-6fc7e2f9f6af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:03.321169 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-301177a0-2e86-4c5c-ad48-6fc7e2f9f6af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:03.321915 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-301177a0-2e86-4c5c-ad48-6fc7e2f9f6af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lazy-loading 'fault' on Instance uuid 82eb59af-b07c-4b0a-9a14-596ee9d70b44 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:26:03.383165 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-301177a0-2e86-4c5c-ad48-6fc7e2f9f6af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:03.395402 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-301177a0-2e86-4c5c-ad48-6fc7e2f9f6af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 200 len: 1304 microversion: 2.1 time: 0.166343 May 19 12:26:03.395402 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 140/309] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:03 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 1304 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:03.921209 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8f73999e-0494-43d1-872d-4fc1a7103eed tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:03.922090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8f73999e-0494-43d1-872d-4fc1a7103eed tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:03.937727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8f73999e-0494-43d1-872d-4fc1a7103eed tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:03.937727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8f73999e-0494-43d1-872d-4fc1a7103eed tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:03.937727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8f73999e-0494-43d1-872d-4fc1a7103eed tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:03.937727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8f73999e-0494-43d1-872d-4fc1a7103eed tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:04.195626 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8f73999e-0494-43d1-872d-4fc1a7103eed tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:04.204251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8f73999e-0494-43d1-872d-4fc1a7103eed tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.290792 May 19 12:26:04.204933 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 170/310] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:03 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:04.414476 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3389a8c7-8b7a-4a95-95e0-9ea9c51f6fc8 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:04.415855 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3389a8c7-8b7a-4a95-95e0-9ea9c51f6fc8 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 82eb59af-b07c-4b0a-9a14-596ee9d70b44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:04.429479 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3389a8c7-8b7a-4a95-95e0-9ea9c51f6fc8 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:04.431217 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3389a8c7-8b7a-4a95-95e0-9ea9c51f6fc8 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:04.432814 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3389a8c7-8b7a-4a95-95e0-9ea9c51f6fc8 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:04.433748 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3389a8c7-8b7a-4a95-95e0-9ea9c51f6fc8 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:04.452517 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-3389a8c7-8b7a-4a95-95e0-9ea9c51f6fc8 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] HTTP exception thrown: Instance 82eb59af-b07c-4b0a-9a14-596ee9d70b44 could not be found. May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3389a8c7-8b7a-4a95-95e0-9ea9c51f6fc8 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Request method failure captured: May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 HTTP/1.1 May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjc3e3EdQ-yeX2WeXYlzmcs51699wmoNneRQH3bxOvb1n9k4fLkxX4EzwZGCnWdRe7rzU-RI6IAasLsXwKIGWC-z4IMh3hO9lHwMyteGAL4_I3M2jxH5BNstWqaF5r4Udpkh4_k_G_iAYUfdIt4qR01yxJ8kFW9xWVGnkHKMK0Yrtkw May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 9f556df7a95041279685098584415ed1 May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesActionsTest-1020965502 May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:26:04.454688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:26:04.456193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9f556df7a95041279685098584415ed1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9f556df7a95041279685098584415ed1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9f556df7a95041279685098584415ed1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9f556df7a95041279685098584415ed1", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:26:04.456193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesActionsTest-1020965502 May 19 12:26:04.456193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 9f556df7a95041279685098584415ed1 May 19 12:26:04.456193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesActionsTest-1020965502 May 19 12:26:04.456193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesActionsTest-1020965502-project May 19 12:26:04.456193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:26:04.456193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:26:04.456193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 7caa126f7eab4eef8db03374e82a6ab9 May 19 12:26:04.456193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesActionsTest-1020965502-project May 19 12:26:04.456193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:26:04.456193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance 82eb59af-b07c-4b0a-9a14-596ee9d70b44 could not be found. May 19 12:26:04.456193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '82eb59af-b07c-4b0a-9a14-596ee9d70b44'} May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82eb59af-b07c-4b0a-9a14-596ee9d70b44 could not be found. May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:26:04.456984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82eb59af-b07c-4b0a-9a14-596ee9d70b44 could not be found. May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82eb59af-b07c-4b0a-9a14-596ee9d70b44 could not be found. May 19 12:26:04.458216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:04.460467 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3389a8c7-8b7a-4a95-95e0-9ea9c51f6fc8 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Returning 404 to user: Instance 82eb59af-b07c-4b0a-9a14-596ee9d70b44 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:26:04.461519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3389a8c7-8b7a-4a95-95e0-9ea9c51f6fc8 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44" status: 404 len: 111 microversion: 2.1 time: 0.054435 May 19 12:26:04.462561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 141/311] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:04 2022] GET /compute/v2.1/servers/82eb59af-b07c-4b0a-9a14-596ee9d70b44 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:26:04.599763 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1699091990", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "networks": [{"uuid": "2a706f2f-b53b-4a57-8c78-98defdba4774"}]}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:04.678024 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.network.neutron [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] validate_networks() for [('2a706f2f-b53b-4a57-8c78-98defdba4774', None, None, None, None, None)] {{(pid=118112) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:26:04.993432 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c0bdf2e2-27f3-4a46-8562-493dc58ac63f tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Action: 'create', calling method: .version_select at 0x7fd4550f1820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1035375038"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:05.231408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Flavor limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:26:05.235193 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Image limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:26:05.240409 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Flavor pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:26:05.240409 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Image pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:26:05.240409 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:26:05.255402 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:05.256208 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:05.257748 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:05.258584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:05.294178 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Getting quotas for project 9f556df7a95041279685098584415ed1. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:26:05.303913 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Getting quotas for user 7caa126f7eab4eef8db03374e82a6ab9 and project 9f556df7a95041279685098584415ed1. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:26:05.326227 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Going to run 1 instances... {{(pid=118112) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:26:05.328906 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:26:05.526139 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-69d7e8b7-19bc-40c8-9020-ca53846bc5e7 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.930680 May 19 12:26:05.527620 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 171/312] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:26:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:26:05.545379 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9f8c4b6f-9084-4d93-8228-98c4d908ecc6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:05.547576 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9f8c4b6f-9084-4d93-8228-98c4d908ecc6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:05.554938 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9f8c4b6f-9084-4d93-8228-98c4d908ecc6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:05.555396 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9f8c4b6f-9084-4d93-8228-98c4d908ecc6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:05.558791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9f8c4b6f-9084-4d93-8228-98c4d908ecc6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:05.558791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9f8c4b6f-9084-4d93-8228-98c4d908ecc6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:05.723412 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9f8c4b6f-9084-4d93-8228-98c4d908ecc6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:05.736886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9f8c4b6f-9084-4d93-8228-98c4d908ecc6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.207700 May 19 12:26:05.738127 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 172/313] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:05 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:05.751736 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5a625185-baec-4c42-879c-a52b729960ae tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:05.754556 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5a625185-baec-4c42-879c-a52b729960ae tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:05.837639 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5a625185-baec-4c42-879c-a52b729960ae tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:05.852111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5a625185-baec-4c42-879c-a52b729960ae tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1214 microversion: 2.1 time: 0.109763 May 19 12:26:05.853158 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 173/314] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:05 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:06.074017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c0bdf2e2-27f3-4a46-8562-493dc58ac63f tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.266007 May 19 12:26:06.075170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 142/315] 10.222.0.57 () {60 vars in 1154 bytes} [Thu May 19 12:26:04 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1270 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 12:26:06.089763 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3c1807f8-b9c0-49ec-b5b1-690f61b2b30a tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd456110c10>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:06.166017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3c1807f8-b9c0-49ec-b5b1-690f61b2b30a tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d" status: 200 len: 345 microversion: 2.1 time: 0.082627 May 19 12:26:06.166512 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 174/316] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:26:06 2022] GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:06.765261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1957c850-c2b1-4fb5-a6d9-ebe1d0649f4f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:06.769300 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1957c850-c2b1-4fb5-a6d9-ebe1d0649f4f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:06.787400 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1957c850-c2b1-4fb5-a6d9-ebe1d0649f4f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:06.788279 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1957c850-c2b1-4fb5-a6d9-ebe1d0649f4f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:06.789806 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1957c850-c2b1-4fb5-a6d9-ebe1d0649f4f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:06.790467 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1957c850-c2b1-4fb5-a6d9-ebe1d0649f4f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:06.869754 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-bb506629-b764-4cbc-92c8-33ca36a28a1a tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:06.870515 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-bb506629-b764-4cbc-92c8-33ca36a28a1a tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:06.949875 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bb506629-b764-4cbc-92c8-33ca36a28a1a tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:06.964521 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-bb506629-b764-4cbc-92c8-33ca36a28a1a tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1214 microversion: 2.1 time: 0.098441 May 19 12:26:06.965552 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 175/317] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:06 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:07.049074 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1957c850-c2b1-4fb5-a6d9-ebe1d0649f4f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:07.059164 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1957c850-c2b1-4fb5-a6d9-ebe1d0649f4f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.307032 May 19 12:26:07.059756 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 143/318] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:06 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:07.186517 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9a87e2ba-deae-49dd-92c0-9592e3bf8cd1 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd4560a7dc0>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:07.253768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9a87e2ba-deae-49dd-92c0-9592e3bf8cd1 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d" status: 200 len: 345 microversion: 2.1 time: 0.078607 May 19 12:26:07.254713 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 176/319] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:26:07 2022] GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:07.991968 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-287fcb30-97d8-4b7a-a9a6-aa49e3db9f88 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:07.992585 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-287fcb30-97d8-4b7a-a9a6-aa49e3db9f88 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:08.000920 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-287fcb30-97d8-4b7a-a9a6-aa49e3db9f88 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:08.001375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-287fcb30-97d8-4b7a-a9a6-aa49e3db9f88 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:08.002165 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-287fcb30-97d8-4b7a-a9a6-aa49e3db9f88 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:08.003312 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-287fcb30-97d8-4b7a-a9a6-aa49e3db9f88 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:08.077391 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-759a68be-e85a-4088-80a2-43b5e501bc6f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:08.077988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-759a68be-e85a-4088-80a2-43b5e501bc6f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:08.085335 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-759a68be-e85a-4088-80a2-43b5e501bc6f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:08.086115 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-759a68be-e85a-4088-80a2-43b5e501bc6f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:08.086967 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-759a68be-e85a-4088-80a2-43b5e501bc6f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:08.087570 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-759a68be-e85a-4088-80a2-43b5e501bc6f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:08.096036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-287fcb30-97d8-4b7a-a9a6-aa49e3db9f88 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:08.127002 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-287fcb30-97d8-4b7a-a9a6-aa49e3db9f88 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1266 microversion: 2.1 time: 0.132503 May 19 12:26:08.128969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 144/320] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:07 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:08.270231 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-882465a4-30f1-422d-a03c-41ff30d2e862 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd456b75160>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:08.359101 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-882465a4-30f1-422d-a03c-41ff30d2e862 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d" status: 200 len: 346 microversion: 2.1 time: 0.092831 May 19 12:26:08.362229 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 145/321] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:26:08 2022] GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:26:08.367474 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-759a68be-e85a-4088-80a2-43b5e501bc6f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:08.375237 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-82f25cda-ad47-43de-b502-44989ac26b53 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Action: 'create', calling method: .version_select at 0x7fd4551189d0>, body: {"snapshot": {"volume_id": "9560abd5-6887-45f9-a588-13c2c539d56d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1482511012"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:08.394667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-759a68be-e85a-4088-80a2-43b5e501bc6f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.320816 May 19 12:26:08.395673 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 177/322] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:08 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:09.155727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b380d177-599d-463d-aeaa-c8ad0124a083 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:09.157317 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b380d177-599d-463d-aeaa-c8ad0124a083 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:09.178515 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b380d177-599d-463d-aeaa-c8ad0124a083 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:09.179231 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b380d177-599d-463d-aeaa-c8ad0124a083 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:09.180210 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b380d177-599d-463d-aeaa-c8ad0124a083 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:09.180820 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b380d177-599d-463d-aeaa-c8ad0124a083 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:09.277819 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b380d177-599d-463d-aeaa-c8ad0124a083 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:09.287976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b380d177-599d-463d-aeaa-c8ad0124a083 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1274 microversion: 2.1 time: 0.138899 May 19 12:26:09.288886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 178/323] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:09 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:09.382902 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-82f25cda-ad47-43de-b502-44989ac26b53 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.011350 May 19 12:26:09.402179 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c400ec33-8e0c-4b3d-918d-e5f0a0939ea9 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd456110a60>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:09.402495 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 146/324] 10.222.0.57 () {60 vars in 1161 bytes} [Thu May 19 12:26:08 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:26:09.427209 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ed3332cf-730a-44e1-ba59-67ba1e721750 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:09.433488 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ed3332cf-730a-44e1-ba59-67ba1e721750 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:09.461799 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ed3332cf-730a-44e1-ba59-67ba1e721750 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:09.462369 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ed3332cf-730a-44e1-ba59-67ba1e721750 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:09.468965 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ed3332cf-730a-44e1-ba59-67ba1e721750 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:09.469558 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ed3332cf-730a-44e1-ba59-67ba1e721750 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:09.650326 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ed3332cf-730a-44e1-ba59-67ba1e721750 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:09.659501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ed3332cf-730a-44e1-ba59-67ba1e721750 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.241720 May 19 12:26:09.660144 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 147/325] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:09 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:09.768207 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c400ec33-8e0c-4b3d-918d-e5f0a0939ea9 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18" status: 200 len: 287 microversion: 2.1 time: 0.373317 May 19 12:26:09.768979 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 179/326] 10.222.0.57 () {58 vars in 1250 bytes} [Thu May 19 12:26:09 2022] GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18 => generated 287 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:09.783897 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5b72cc14-98aa-4cb3-ace7-646c7978e6b9 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd4550f1550>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:09.889894 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5b72cc14-98aa-4cb3-ace7-646c7978e6b9 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.111367 May 19 12:26:09.894710 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 148/327] 10.222.0.57 () {58 vars in 1139 bytes} [Thu May 19 12:26:09 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:09.910780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-298d9018-f531-4e4b-b53b-21f0191dcaf4 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd4560a7c10>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:09.953608 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-298d9018-f531-4e4b-b53b-21f0191dcaf4 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18" status: 200 len: 287 microversion: 2.1 time: 0.052305 May 19 12:26:09.954963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 180/328] 10.222.0.57 () {58 vars in 1250 bytes} [Thu May 19 12:26:09 2022] GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:10.314173 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7b06c96f-3a0d-4e04-b90b-f9b12fb79ca5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:10.315298 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7b06c96f-3a0d-4e04-b90b-f9b12fb79ca5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:10.326638 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b06c96f-3a0d-4e04-b90b-f9b12fb79ca5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:10.327440 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b06c96f-3a0d-4e04-b90b-f9b12fb79ca5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:10.331038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b06c96f-3a0d-4e04-b90b-f9b12fb79ca5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:10.331741 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b06c96f-3a0d-4e04-b90b-f9b12fb79ca5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:10.504829 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7b06c96f-3a0d-4e04-b90b-f9b12fb79ca5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:10.512734 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7b06c96f-3a0d-4e04-b90b-f9b12fb79ca5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1314 microversion: 2.1 time: 0.206825 May 19 12:26:10.513328 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 149/329] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:10 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:10.683130 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-7d193f00-d600-4f10-8425-efa69df222d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:10.684047 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-7d193f00-d600-4f10-8425-efa69df222d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:10.697245 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7d193f00-d600-4f10-8425-efa69df222d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:10.697927 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7d193f00-d600-4f10-8425-efa69df222d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:10.699007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7d193f00-d600-4f10-8425-efa69df222d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:10.699553 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7d193f00-d600-4f10-8425-efa69df222d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:10.900942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-7d193f00-d600-4f10-8425-efa69df222d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:10.910572 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-7d193f00-d600-4f10-8425-efa69df222d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.233559 May 19 12:26:10.911160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 181/330] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:10 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:10.971282 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-85b671de-b647-48ba-b601-df231ca1365f tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd455107ca0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:11.006522 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-85b671de-b647-48ba-b601-df231ca1365f tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18" status: 200 len: 287 microversion: 2.1 time: 0.041541 May 19 12:26:11.007218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 150/331] 10.222.0.57 () {58 vars in 1250 bytes} [Thu May 19 12:26:10 2022] GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:11.532556 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-29775519-4b5c-42af-a00e-160ed019b26d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:11.533044 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-29775519-4b5c-42af-a00e-160ed019b26d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:11.539785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29775519-4b5c-42af-a00e-160ed019b26d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:11.540362 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29775519-4b5c-42af-a00e-160ed019b26d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:11.541229 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29775519-4b5c-42af-a00e-160ed019b26d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:11.541764 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29775519-4b5c-42af-a00e-160ed019b26d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:11.712586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-b9c2dfe4-4a82-44fb-b584-188fa02e7f6e req-dfbb52a9-f4bc-4bf5-a8c9-54e0d50fb8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991ff17d-491e-4b3c-bc58-92fec10f95ae", "tag": "3aca7d5e-b386-484d-abce-0842a7bdf3a6"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:11.720022 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:11.728925 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-b9c2dfe4-4a82-44fb-b584-188fa02e7f6e req-dfbb52a9-f4bc-4bf5-a8c9-54e0d50fb8c6 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:11.729655 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-b9c2dfe4-4a82-44fb-b584-188fa02e7f6e req-dfbb52a9-f4bc-4bf5-a8c9-54e0d50fb8c6 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:11.733898 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-29775519-4b5c-42af-a00e-160ed019b26d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:11.744375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-b9c2dfe4-4a82-44fb-b584-188fa02e7f6e req-dfbb52a9-f4bc-4bf5-a8c9-54e0d50fb8c6 service nova] Creating event network-changed:3aca7d5e-b386-484d-abce-0842a7bdf3a6 for instance 991ff17d-491e-4b3c-bc58-92fec10f95ae on hv-cinder-77819 May 19 12:26:11.744753 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-29775519-4b5c-42af-a00e-160ed019b26d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1314 microversion: 2.1 time: 0.217200 May 19 12:26:11.745436 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 182/332] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:11 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:11.749767 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-b9c2dfe4-4a82-44fb-b584-188fa02e7f6e req-dfbb52a9-f4bc-4bf5-a8c9-54e0d50fb8c6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049654 May 19 12:26:11.756259 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 151/333] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:11.928168 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0417d159-e656-495d-9a5e-a71dbde425b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:11.928808 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0417d159-e656-495d-9a5e-a71dbde425b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:11.935852 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0417d159-e656-495d-9a5e-a71dbde425b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:11.936732 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0417d159-e656-495d-9a5e-a71dbde425b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:11.947595 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0417d159-e656-495d-9a5e-a71dbde425b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:11.947595 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0417d159-e656-495d-9a5e-a71dbde425b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:12.031261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a49277ae-3c85-4e13-afea-0c9dcdf81d31 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd455115040>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:12.064476 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a49277ae-3c85-4e13-afea-0c9dcdf81d31 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18" status: 200 len: 287 microversion: 2.1 time: 0.046619 May 19 12:26:12.069213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 152/334] 10.222.0.57 () {58 vars in 1250 bytes} [Thu May 19 12:26:12 2022] GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:26:12.089971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0417d159-e656-495d-9a5e-a71dbde425b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:12.098695 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0417d159-e656-495d-9a5e-a71dbde425b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.174778 May 19 12:26:12.099296 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 183/335] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:11 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:12.774204 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0a6b4946-45a8-49d8-8429-ab0ae8062585 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:12.775030 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0a6b4946-45a8-49d8-8429-ab0ae8062585 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:12.783048 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a6b4946-45a8-49d8-8429-ab0ae8062585 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:12.783496 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a6b4946-45a8-49d8-8429-ab0ae8062585 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:12.784273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a6b4946-45a8-49d8-8429-ab0ae8062585 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:12.784702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a6b4946-45a8-49d8-8429-ab0ae8062585 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:12.965123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0a6b4946-45a8-49d8-8429-ab0ae8062585 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:12.975179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0a6b4946-45a8-49d8-8429-ab0ae8062585 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1314 microversion: 2.1 time: 0.206675 May 19 12:26:12.975818 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 153/336] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:12 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:13.082083 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2fcf99b4-7718-45c8-8ed2-83d68de291b7 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd4564a39d0>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:13.118869 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4a28caa8-b4a6-41ee-a29e-29a15294d272 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:13.119640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4a28caa8-b4a6-41ee-a29e-29a15294d272 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:13.127540 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a28caa8-b4a6-41ee-a29e-29a15294d272 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:13.127990 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a28caa8-b4a6-41ee-a29e-29a15294d272 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:13.128784 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a28caa8-b4a6-41ee-a29e-29a15294d272 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:13.129617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a28caa8-b4a6-41ee-a29e-29a15294d272 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:13.133263 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2fcf99b4-7718-45c8-8ed2-83d68de291b7 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18" status: 200 len: 287 microversion: 2.1 time: 0.058546 May 19 12:26:13.135616 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 184/337] 10.222.0.57 () {58 vars in 1250 bytes} [Thu May 19 12:26:13 2022] GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:13.282862 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4a28caa8-b4a6-41ee-a29e-29a15294d272 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:13.291190 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4a28caa8-b4a6-41ee-a29e-29a15294d272 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.177489 May 19 12:26:13.291780 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 154/338] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:13 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:13.993682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b7cd399c-13a7-4507-a256-59c4f16d8ae4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:13.994362 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b7cd399c-13a7-4507-a256-59c4f16d8ae4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:14.001563 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b7cd399c-13a7-4507-a256-59c4f16d8ae4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:14.002128 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b7cd399c-13a7-4507-a256-59c4f16d8ae4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:14.003068 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b7cd399c-13a7-4507-a256-59c4f16d8ae4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:14.003675 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b7cd399c-13a7-4507-a256-59c4f16d8ae4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:14.153252 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-80e66a2f-0920-405c-9592-4bab7dbce55c tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd4550f13a0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:14.172184 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b7cd399c-13a7-4507-a256-59c4f16d8ae4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:14.182000 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b7cd399c-13a7-4507-a256-59c4f16d8ae4 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1314 microversion: 2.1 time: 0.192489 May 19 12:26:14.182726 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 185/339] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:13 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:14.200942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-80e66a2f-0920-405c-9592-4bab7dbce55c tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18" status: 200 len: 287 microversion: 2.1 time: 0.054377 May 19 12:26:14.201934 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 155/340] 10.222.0.57 () {58 vars in 1250 bytes} [Thu May 19 12:26:14 2022] GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:26:14.314316 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d04d0004-feb7-4178-992c-5b0c6632473a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:14.315570 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d04d0004-feb7-4178-992c-5b0c6632473a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:14.326907 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d04d0004-feb7-4178-992c-5b0c6632473a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:14.327522 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d04d0004-feb7-4178-992c-5b0c6632473a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:14.328492 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d04d0004-feb7-4178-992c-5b0c6632473a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:14.328931 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d04d0004-feb7-4178-992c-5b0c6632473a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:14.504894 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d04d0004-feb7-4178-992c-5b0c6632473a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:14.513182 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d04d0004-feb7-4178-992c-5b0c6632473a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.205588 May 19 12:26:14.513775 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 186/341] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:14 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:15.204685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-626b273a-926b-4cd7-b4cc-b9bdddb5481c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:15.205292 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-626b273a-926b-4cd7-b4cc-b9bdddb5481c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:15.213086 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-626b273a-926b-4cd7-b4cc-b9bdddb5481c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:15.213591 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-626b273a-926b-4cd7-b4cc-b9bdddb5481c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:15.214446 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-626b273a-926b-4cd7-b4cc-b9bdddb5481c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:15.214880 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-626b273a-926b-4cd7-b4cc-b9bdddb5481c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:15.218185 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8c047614-3a91-433a-9648-fa3796e8358a tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd456110b80>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:15.271410 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8c047614-3a91-433a-9648-fa3796e8358a tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18" status: 200 len: 287 microversion: 2.1 time: 0.057541 May 19 12:26:15.272378 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 187/342] 10.222.0.57 () {58 vars in 1250 bytes} [Thu May 19 12:26:15 2022] GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:26:15.378261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-626b273a-926b-4cd7-b4cc-b9bdddb5481c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:15.380984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:15.388120 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-626b273a-926b-4cd7-b4cc-b9bdddb5481c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1314 microversion: 2.1 time: 0.190741 May 19 12:26:15.394510 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 156/343] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:15 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:15.537481 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:15.544615 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-132caa5f-1541-4408-a0ca-43bdaa10ecf7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:15.546082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-132caa5f-1541-4408-a0ca-43bdaa10ecf7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:15.556623 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-132caa5f-1541-4408-a0ca-43bdaa10ecf7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:15.557333 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-132caa5f-1541-4408-a0ca-43bdaa10ecf7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:15.558618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-132caa5f-1541-4408-a0ca-43bdaa10ecf7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:15.559282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-132caa5f-1541-4408-a0ca-43bdaa10ecf7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:15.776821 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-132caa5f-1541-4408-a0ca-43bdaa10ecf7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:15.787933 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-132caa5f-1541-4408-a0ca-43bdaa10ecf7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.251861 May 19 12:26:15.788656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 188/344] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:15 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:16.288972 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7b6ec73d-34c1-4587-aaae-3fdb404b72dd tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd4550f1550>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:16.338956 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7b6ec73d-34c1-4587-aaae-3fdb404b72dd tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18" status: 200 len: 288 microversion: 2.1 time: 0.054443 May 19 12:26:16.339947 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 157/345] 10.222.0.57 () {58 vars in 1250 bytes} [Thu May 19 12:26:16 2022] GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18 => generated 288 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:16.362326 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b6bbb1f5-8a1c-4b74-936a-621e3aa6ca64 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd4560d7af0>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:16.415074 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a7d2fdc1-05d3-4363-acf1-712095e9b048 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:16.416648 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a7d2fdc1-05d3-4363-acf1-712095e9b048 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:16.432643 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a7d2fdc1-05d3-4363-acf1-712095e9b048 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:16.433609 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a7d2fdc1-05d3-4363-acf1-712095e9b048 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:16.435201 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a7d2fdc1-05d3-4363-acf1-712095e9b048 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:16.436133 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a7d2fdc1-05d3-4363-acf1-712095e9b048 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:16.547950 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b6bbb1f5-8a1c-4b74-936a-621e3aa6ca64 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18" status: 202 len: 0 microversion: 2.1 time: 0.188572 May 19 12:26:16.547950 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 189/346] 10.222.0.57 () {58 vars in 1253 bytes} [Thu May 19 12:26:16 2022] DELETE /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:26:16.558776 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-cde5cd37-426e-42d4-a202-e38eeef7a4b2 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd4560d7430>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:16.608400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-cde5cd37-426e-42d4-a202-e38eeef7a4b2 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18" status: 200 len: 287 microversion: 2.1 time: 0.054482 May 19 12:26:16.609278 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 190/347] 10.222.0.57 () {58 vars in 1250 bytes} [Thu May 19 12:26:16 2022] GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:26:16.635022 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a7d2fdc1-05d3-4363-acf1-712095e9b048 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:16.644136 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a7d2fdc1-05d3-4363-acf1-712095e9b048 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1314 microversion: 2.1 time: 0.240579 May 19 12:26:16.644718 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 158/348] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:16 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:16.807523 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d6310058-9ae3-48f4-8043-b4e90fd29167 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:16.808137 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d6310058-9ae3-48f4-8043-b4e90fd29167 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:16.815776 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d6310058-9ae3-48f4-8043-b4e90fd29167 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:16.816231 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d6310058-9ae3-48f4-8043-b4e90fd29167 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:16.817030 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d6310058-9ae3-48f4-8043-b4e90fd29167 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:16.817518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d6310058-9ae3-48f4-8043-b4e90fd29167 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:16.956799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=10 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:16.978630 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d6310058-9ae3-48f4-8043-b4e90fd29167 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:16.989307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d6310058-9ae3-48f4-8043-b4e90fd29167 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.185606 May 19 12:26:16.989918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 191/349] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:16 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:17.630871 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-710a49af-68e9-40a9-ac2b-1f1cb0ca07d0 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd4550f1430>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:17.663500 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fc80ff11-ec89-4010-8520-7308d48f01af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:17.664756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fc80ff11-ec89-4010-8520-7308d48f01af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:17.665400 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-710a49af-68e9-40a9-ac2b-1f1cb0ca07d0 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] HTTP exception thrown: Snapshot 790c875f-1c89-4ee9-a7cf-44fd125fbe18 could not be found. May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-710a49af-68e9-40a9-ac2b-1f1cb0ca07d0 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Request method failure captured: May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18 HTTP/1.1 May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjdczMN-WZkdstuCzplxQKzhdGsN_lWgmck0Kj0o7IP5SHGNNx91sh_naLiGR7AyN6oFAxR8_ttFh2rSC4nmK6IxR20BT9LNKsu_R70_k0YSVNbkrBdpSOIIV-dCDUsd5eJlIBj1a8agwRoAX6I2-q6QQQYkja3LCVJVD5VsjvuXSbA May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 350cba15727143359613e4f1369b8efd May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-990709093 May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:26:17.669404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:26:17.671981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/350cba15727143359613e4f1369b8efd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/350cba15727143359613e4f1369b8efd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/350cba15727143359613e4f1369b8efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_350cba15727143359613e4f1369b8efd", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:26:17.671981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesSnapshotsTestJSON-990709093 May 19 12:26:17.671981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 350cba15727143359613e4f1369b8efd May 19 12:26:17.671981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-990709093 May 19 12:26:17.671981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesSnapshotsTestJSON-990709093-project May 19 12:26:17.671981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:26:17.671981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:26:17.671981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 4741fd44d9b2449fb3e40bccae27d84f May 19 12:26:17.671981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesSnapshotsTestJSON-990709093-project May 19 12:26:17.671981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: May 19 12:26:17.671981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Snapshot 790c875f-1c89-4ee9-a7cf-44fd125fbe18 could not be found. May 19 12:26:17.671981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '790c875f-1c89-4ee9-a7cf-44fd125fbe18'} May 19 12:26:17.671981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 790c875f-1c89-4ee9-a7cf-44fd125fbe18 could not be found. (HTTP 404) (Request-ID: req-0341af1c-195f-4c2a-b202-2b5a28557b9a) May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:17.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:26:17.673753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 790c875f-1c89-4ee9-a7cf-44fd125fbe18 could not be found. May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 19 12:26:17.676129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:26:17.677534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 790c875f-1c89-4ee9-a7cf-44fd125fbe18 could not be found. May 19 12:26:17.677534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:17.677534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:17.677534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:17.677534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:17.677534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:17.677534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:17.677534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:26:17.677534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:26:17.677534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 790c875f-1c89-4ee9-a7cf-44fd125fbe18 could not be found. May 19 12:26:17.677534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:17.677534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-710a49af-68e9-40a9-ac2b-1f1cb0ca07d0 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Returning 404 to user: Snapshot 790c875f-1c89-4ee9-a7cf-44fd125fbe18 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:26:17.677534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-710a49af-68e9-40a9-ac2b-1f1cb0ca07d0 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18" status: 404 len: 111 microversion: 2.1 time: 0.054868 May 19 12:26:17.678538 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc80ff11-ec89-4010-8520-7308d48f01af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:17.678538 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc80ff11-ec89-4010-8520-7308d48f01af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:17.678538 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc80ff11-ec89-4010-8520-7308d48f01af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:17.678538 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc80ff11-ec89-4010-8520-7308d48f01af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:17.679791 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 159/350] 10.222.0.57 () {58 vars in 1250 bytes} [Thu May 19 12:26:17 2022] GET /compute/v2.1/os-snapshots/790c875f-1c89-4ee9-a7cf-44fd125fbe18 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:26:17.685569 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-531d29ca-653b-4ee8-b44e-5bfc0647df1d tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd4551078b0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:17.849155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fc80ff11-ec89-4010-8520-7308d48f01af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:17.859055 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fc80ff11-ec89-4010-8520-7308d48f01af tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1314 microversion: 2.1 time: 0.199233 May 19 12:26:17.859055 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 192/351] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:17 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:17.918036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-531d29ca-653b-4ee8-b44e-5bfc0647df1d tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d" status: 202 len: 0 microversion: 2.1 time: 0.236674 May 19 12:26:17.919418 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 160/352] 10.222.0.57 () {58 vars in 1247 bytes} [Thu May 19 12:26:17 2022] DELETE /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:26:17.931292 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d205ac87-7cc9-4753-9a02-ee7a56057ea0 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd4560a7b80>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:18.000468 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d205ac87-7cc9-4753-9a02-ee7a56057ea0 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d" status: 200 len: 345 microversion: 2.1 time: 0.073910 May 19 12:26:18.001287 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 193/353] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:26:17 2022] GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:26:18.016318 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c70408ba-7852-425d-bfe9-7e51614c5ec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:18.017175 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c70408ba-7852-425d-bfe9-7e51614c5ec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:18.026387 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c70408ba-7852-425d-bfe9-7e51614c5ec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:18.027164 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c70408ba-7852-425d-bfe9-7e51614c5ec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:18.028301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c70408ba-7852-425d-bfe9-7e51614c5ec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:18.028867 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c70408ba-7852-425d-bfe9-7e51614c5ec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:18.228543 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c70408ba-7852-425d-bfe9-7e51614c5ec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:18.238180 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c70408ba-7852-425d-bfe9-7e51614c5ec9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.227848 May 19 12:26:18.240963 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 161/354] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:18 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:18.875901 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f919f101-3755-4dd4-b480-947b4dc28c17 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:18.876563 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f919f101-3755-4dd4-b480-947b4dc28c17 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:18.883744 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f919f101-3755-4dd4-b480-947b4dc28c17 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:18.884393 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f919f101-3755-4dd4-b480-947b4dc28c17 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:18.885293 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f919f101-3755-4dd4-b480-947b4dc28c17 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:18.885781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f919f101-3755-4dd4-b480-947b4dc28c17 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:19.021439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7efac618-938d-4979-9a8a-0a24e26f9fbe tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd455240670>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:19.077804 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-7efac618-938d-4979-9a8a-0a24e26f9fbe tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] HTTP exception thrown: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7efac618-938d-4979-9a8a-0a24e26f9fbe tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Request method failure captured: May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d HTTP/1.1 May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjdczMN-WZkdstuCzplxQKzhdGsN_lWgmck0Kj0o7IP5SHGNNx91sh_naLiGR7AyN6oFAxR8_ttFh2rSC4nmK6IxR20BT9LNKsu_R70_k0YSVNbkrBdpSOIIV-dCDUsd5eJlIBj1a8agwRoAX6I2-q6QQQYkja3LCVJVD5VsjvuXSbA May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 350cba15727143359613e4f1369b8efd May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-990709093 May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:26:19.082036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:26:19.084396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/350cba15727143359613e4f1369b8efd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/350cba15727143359613e4f1369b8efd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/350cba15727143359613e4f1369b8efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_350cba15727143359613e4f1369b8efd", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:26:19.084396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesSnapshotsTestJSON-990709093 May 19 12:26:19.084396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 350cba15727143359613e4f1369b8efd May 19 12:26:19.084396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-990709093 May 19 12:26:19.084396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesSnapshotsTestJSON-990709093-project May 19 12:26:19.084396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:26:19.084396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:26:19.084396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 4741fd44d9b2449fb3e40bccae27d84f May 19 12:26:19.084396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesSnapshotsTestJSON-990709093-project May 19 12:26:19.084396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: May 19 12:26:19.084396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.084396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '9560abd5-6887-45f9-a588-13c2c539d56d'} May 19 12:26:19.084396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. (HTTP 404) (Request-ID: req-50557752-ed47-44ad-baa7-c359cd7768d3) May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:19.086081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:26:19.091373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 12:26:19.100503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7efac618-938d-4979-9a8a-0a24e26f9fbe tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Returning 404 to user: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7efac618-938d-4979-9a8a-0a24e26f9fbe tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d" status: 404 len: 109 microversion: 2.1 time: 0.081821 May 19 12:26:19.104673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 162/355] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:26:19 2022] GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:26:19.131828 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c0b7785b-f79e-491b-93ab-c801b6ee9409 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd45529cf70>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:19.169503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-c0b7785b-f79e-491b-93ab-c801b6ee9409 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] HTTP exception thrown: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c0b7785b-f79e-491b-93ab-c801b6ee9409 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Request method failure captured: May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d HTTP/1.1 May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjdczMN-WZkdstuCzplxQKzhdGsN_lWgmck0Kj0o7IP5SHGNNx91sh_naLiGR7AyN6oFAxR8_ttFh2rSC4nmK6IxR20BT9LNKsu_R70_k0YSVNbkrBdpSOIIV-dCDUsd5eJlIBj1a8agwRoAX6I2-q6QQQYkja3LCVJVD5VsjvuXSbA May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 350cba15727143359613e4f1369b8efd May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-990709093 May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:26:19.172179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:26:19.174601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/350cba15727143359613e4f1369b8efd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/350cba15727143359613e4f1369b8efd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/350cba15727143359613e4f1369b8efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_350cba15727143359613e4f1369b8efd", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:26:19.174601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesSnapshotsTestJSON-990709093 May 19 12:26:19.174601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 350cba15727143359613e4f1369b8efd May 19 12:26:19.174601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-990709093 May 19 12:26:19.174601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesSnapshotsTestJSON-990709093-project May 19 12:26:19.174601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:26:19.174601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:26:19.174601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 4741fd44d9b2449fb3e40bccae27d84f May 19 12:26:19.174601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesSnapshotsTestJSON-990709093-project May 19 12:26:19.174601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: May 19 12:26:19.174601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.174601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '9560abd5-6887-45f9-a588-13c2c539d56d'} May 19 12:26:19.174601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. (HTTP 404) (Request-ID: req-742115d1-3d85-4141-979f-aac22f2b2590) May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:19.176262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 12:26:19.194003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 12:26:19.196458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c0b7785b-f79e-491b-93ab-c801b6ee9409 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Returning 404 to user: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c0b7785b-f79e-491b-93ab-c801b6ee9409 tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d" status: 404 len: 109 microversion: 2.1 time: 0.058774 May 19 12:26:19.198640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 163/356] 10.222.0.57 () {58 vars in 1247 bytes} [Thu May 19 12:26:19 2022] DELETE /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:26:19.200327 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6cc98e21-d667-4f3c-865b-121087d23bcb tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Calling method '.version_select at 0x7fd45529ca60>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:19.225714 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-6cc98e21-d667-4f3c-865b-121087d23bcb tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] HTTP exception thrown: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6cc98e21-d667-4f3c-865b-121087d23bcb tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Request method failure captured: May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d HTTP/1.1 May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjdczMN-WZkdstuCzplxQKzhdGsN_lWgmck0Kj0o7IP5SHGNNx91sh_naLiGR7AyN6oFAxR8_ttFh2rSC4nmK6IxR20BT9LNKsu_R70_k0YSVNbkrBdpSOIIV-dCDUsd5eJlIBj1a8agwRoAX6I2-q6QQQYkja3LCVJVD5VsjvuXSbA May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 350cba15727143359613e4f1369b8efd May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-990709093 May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:26:19.228177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:26:19.236519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/350cba15727143359613e4f1369b8efd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/350cba15727143359613e4f1369b8efd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/350cba15727143359613e4f1369b8efd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_350cba15727143359613e4f1369b8efd", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:26:19.236519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesSnapshotsTestJSON-990709093 May 19 12:26:19.236519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 350cba15727143359613e4f1369b8efd May 19 12:26:19.236519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-990709093 May 19 12:26:19.236519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesSnapshotsTestJSON-990709093-project May 19 12:26:19.236519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:26:19.236519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:26:19.236519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 4741fd44d9b2449fb3e40bccae27d84f May 19 12:26:19.236519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesSnapshotsTestJSON-990709093-project May 19 12:26:19.236519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: May 19 12:26:19.236519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.236519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '9560abd5-6887-45f9-a588-13c2c539d56d'} May 19 12:26:19.236519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. (HTTP 404) (Request-ID: req-7fe5a39a-d27c-4e22-b6b1-0ce5412df7b6) May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:19.238010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:26:19.240355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 12:26:19.242546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6cc98e21-d667-4f3c-865b-121087d23bcb tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] Returning 404 to user: Volume 9560abd5-6887-45f9-a588-13c2c539d56d could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6cc98e21-d667-4f3c-865b-121087d23bcb tempest-VolumesSnapshotsTestJSON-990709093 tempest-VolumesSnapshotsTestJSON-990709093-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d" status: 404 len: 109 microversion: 2.1 time: 0.048701 May 19 12:26:19.244812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 164/357] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:26:19 2022] GET /compute/v2.1/os-volumes/9560abd5-6887-45f9-a588-13c2c539d56d => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:26:19.274330 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9d6f44d0-7dad-43af-8d55-485b5ab3ebaf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:19.275099 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9d6f44d0-7dad-43af-8d55-485b5ab3ebaf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:19.291493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d6f44d0-7dad-43af-8d55-485b5ab3ebaf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:19.291493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d6f44d0-7dad-43af-8d55-485b5ab3ebaf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:19.291493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d6f44d0-7dad-43af-8d55-485b5ab3ebaf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:19.291493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d6f44d0-7dad-43af-8d55-485b5ab3ebaf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:19.428993 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f919f101-3755-4dd4-b480-947b4dc28c17 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:19.449844 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f919f101-3755-4dd4-b480-947b4dc28c17 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1314 microversion: 2.1 time: 0.578470 May 19 12:26:19.450486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 194/358] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:18 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:19.553970 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9d6f44d0-7dad-43af-8d55-485b5ab3ebaf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:19.563206 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9d6f44d0-7dad-43af-8d55-485b5ab3ebaf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.297530 May 19 12:26:19.563849 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 165/359] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:19 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:20.524850 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c8ea3429-438c-42a1-a8d5-062c68ebe14c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:20.526650 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c8ea3429-438c-42a1-a8d5-062c68ebe14c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:20.538738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c8ea3429-438c-42a1-a8d5-062c68ebe14c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:20.539516 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c8ea3429-438c-42a1-a8d5-062c68ebe14c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:20.540889 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c8ea3429-438c-42a1-a8d5-062c68ebe14c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:20.541513 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c8ea3429-438c-42a1-a8d5-062c68ebe14c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:20.587271 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ea43ed89-f4a7-4d3e-ab77-0764816da979 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:20.588762 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ea43ed89-f4a7-4d3e-ab77-0764816da979 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:20.611754 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea43ed89-f4a7-4d3e-ab77-0764816da979 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:20.617405 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea43ed89-f4a7-4d3e-ab77-0764816da979 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:20.617405 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea43ed89-f4a7-4d3e-ab77-0764816da979 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:20.617405 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ea43ed89-f4a7-4d3e-ab77-0764816da979 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:20.960057 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c8ea3429-438c-42a1-a8d5-062c68ebe14c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:20.963539 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:20.977320 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c8ea3429-438c-42a1-a8d5-062c68ebe14c tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1314 microversion: 2.1 time: 0.458575 May 19 12:26:20.979671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 195/360] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:20 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:21.006834 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ea43ed89-f4a7-4d3e-ab77-0764816da979 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:21.016140 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ea43ed89-f4a7-4d3e-ab77-0764816da979 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.436583 May 19 12:26:21.016834 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 166/361] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:20 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:22.001070 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e19983d3-3c91-4be7-90e6-e20bc9f72323 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:22.002238 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e19983d3-3c91-4be7-90e6-e20bc9f72323 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:22.015471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e19983d3-3c91-4be7-90e6-e20bc9f72323 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:22.016431 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e19983d3-3c91-4be7-90e6-e20bc9f72323 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:22.018078 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e19983d3-3c91-4be7-90e6-e20bc9f72323 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:22.019318 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e19983d3-3c91-4be7-90e6-e20bc9f72323 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:22.039668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-667f2ca8-ab96-4be5-9f17-ca7481366ad9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:22.041638 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-667f2ca8-ab96-4be5-9f17-ca7481366ad9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:22.050397 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-667f2ca8-ab96-4be5-9f17-ca7481366ad9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:22.051342 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-667f2ca8-ab96-4be5-9f17-ca7481366ad9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:22.052345 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-667f2ca8-ab96-4be5-9f17-ca7481366ad9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:22.052863 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-667f2ca8-ab96-4be5-9f17-ca7481366ad9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:22.437555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e19983d3-3c91-4be7-90e6-e20bc9f72323 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:22.481556 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e19983d3-3c91-4be7-90e6-e20bc9f72323 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1314 microversion: 2.1 time: 0.483932 May 19 12:26:22.498531 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 196/362] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:21 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:22.502070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-667f2ca8-ab96-4be5-9f17-ca7481366ad9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:22.531289 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-667f2ca8-ab96-4be5-9f17-ca7481366ad9 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.494785 May 19 12:26:22.537263 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 167/363] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:22 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:23.522470 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-7d66e6c4-951a-4337-89e0-6de1226676a5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:23.524648 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-7d66e6c4-951a-4337-89e0-6de1226676a5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:23.536655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7d66e6c4-951a-4337-89e0-6de1226676a5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:23.537493 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7d66e6c4-951a-4337-89e0-6de1226676a5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:23.539269 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7d66e6c4-951a-4337-89e0-6de1226676a5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:23.540002 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7d66e6c4-951a-4337-89e0-6de1226676a5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:23.569308 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-54790088-fd97-4323-90a1-b17918e8a3f3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:23.573122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-54790088-fd97-4323-90a1-b17918e8a3f3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:23.607729 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-54790088-fd97-4323-90a1-b17918e8a3f3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:23.609252 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-54790088-fd97-4323-90a1-b17918e8a3f3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:23.611130 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-54790088-fd97-4323-90a1-b17918e8a3f3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:23.612879 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-54790088-fd97-4323-90a1-b17918e8a3f3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:23.896602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-54790088-fd97-4323-90a1-b17918e8a3f3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:23.902328 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-7d66e6c4-951a-4337-89e0-6de1226676a5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:23.915725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-54790088-fd97-4323-90a1-b17918e8a3f3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1522 microversion: 2.1 time: 0.356527 May 19 12:26:23.916393 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-7d66e6c4-951a-4337-89e0-6de1226676a5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1314 microversion: 2.1 time: 0.401302 May 19 12:26:23.930447 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 168/364] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:23 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:23.933993 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 197/365] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:23 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:24.063290 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-4938f7ea-b69e-4ecd-a647-0fde551da1b7 req-abef4208-88a9-460d-b69d-ad4a440d2658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991ff17d-491e-4b3c-bc58-92fec10f95ae", "name": "network-vif-plugged", "status": "completed", "tag": "3aca7d5e-b386-484d-abce-0842a7bdf3a6"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:24.104204 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4938f7ea-b69e-4ecd-a647-0fde551da1b7 req-abef4208-88a9-460d-b69d-ad4a440d2658 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:24.104204 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4938f7ea-b69e-4ecd-a647-0fde551da1b7 req-abef4208-88a9-460d-b69d-ad4a440d2658 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:24.117311 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-4938f7ea-b69e-4ecd-a647-0fde551da1b7 req-abef4208-88a9-460d-b69d-ad4a440d2658 service nova] Creating event network-vif-plugged:3aca7d5e-b386-484d-abce-0842a7bdf3a6 for instance 991ff17d-491e-4b3c-bc58-92fec10f95ae on hv-cinder-77819 May 19 12:26:24.127096 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-4938f7ea-b69e-4ecd-a647-0fde551da1b7 req-abef4208-88a9-460d-b69d-ad4a440d2658 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068211 May 19 12:26:24.127840 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 169/366] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:24.939659 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-19991c0b-bead-4315-9def-faa72ce1b2c9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:24.940934 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-19991c0b-bead-4315-9def-faa72ce1b2c9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:24.952642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-12130ddb-e928-48ef-a6d6-5b32f8c481de tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:24.953535 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-19991c0b-bead-4315-9def-faa72ce1b2c9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:24.953535 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-19991c0b-bead-4315-9def-faa72ce1b2c9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:24.954959 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-19991c0b-bead-4315-9def-faa72ce1b2c9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:24.955503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-12130ddb-e928-48ef-a6d6-5b32f8c481de tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:24.955739 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-19991c0b-bead-4315-9def-faa72ce1b2c9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:24.966353 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12130ddb-e928-48ef-a6d6-5b32f8c481de tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:24.967754 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12130ddb-e928-48ef-a6d6-5b32f8c481de tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:24.969515 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12130ddb-e928-48ef-a6d6-5b32f8c481de tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:24.970258 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12130ddb-e928-48ef-a6d6-5b32f8c481de tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:25.327241 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-19991c0b-bead-4315-9def-faa72ce1b2c9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:25.336196 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-19991c0b-bead-4315-9def-faa72ce1b2c9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1314 microversion: 2.1 time: 0.402540 May 19 12:26:25.336827 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 198/367] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:24 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:25.339457 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-12130ddb-e928-48ef-a6d6-5b32f8c481de tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:25.350770 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-12130ddb-e928-48ef-a6d6-5b32f8c481de tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1502 microversion: 2.1 time: 0.407956 May 19 12:26:25.351358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 170/368] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:24 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1502 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:25.368081 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-af30533a-2df0-4b20-8862-43750af67b11 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:25.368704 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-af30533a-2df0-4b20-8862-43750af67b11 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:25.370728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:25.377103 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-af30533a-2df0-4b20-8862-43750af67b11 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:25.377555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-af30533a-2df0-4b20-8862-43750af67b11 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:25.378369 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-af30533a-2df0-4b20-8862-43750af67b11 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:25.378873 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-af30533a-2df0-4b20-8862-43750af67b11 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:25.580192 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-af30533a-2df0-4b20-8862-43750af67b11 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:25.588936 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-af30533a-2df0-4b20-8862-43750af67b11 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1516 microversion: 2.1 time: 0.224641 May 19 12:26:25.589583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 199/369] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:25 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1516 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:26.363406 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3483cca2-4a30-45bf-8be8-2c876955f9fc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:26.364874 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3483cca2-4a30-45bf-8be8-2c876955f9fc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:26.380168 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3483cca2-4a30-45bf-8be8-2c876955f9fc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:26.381095 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3483cca2-4a30-45bf-8be8-2c876955f9fc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:26.382881 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3483cca2-4a30-45bf-8be8-2c876955f9fc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:26.383724 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3483cca2-4a30-45bf-8be8-2c876955f9fc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:26.577094 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3483cca2-4a30-45bf-8be8-2c876955f9fc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:26.592303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3483cca2-4a30-45bf-8be8-2c876955f9fc tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1314 microversion: 2.1 time: 0.235413 May 19 12:26:26.593210 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 171/370] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:26 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:27.616591 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a1365c3e-f814-464e-8199-d2a14823e4f5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:27.617460 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a1365c3e-f814-464e-8199-d2a14823e4f5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:27.626549 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a1365c3e-f814-464e-8199-d2a14823e4f5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:27.628117 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a1365c3e-f814-464e-8199-d2a14823e4f5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:27.628117 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a1365c3e-f814-464e-8199-d2a14823e4f5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:27.628594 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a1365c3e-f814-464e-8199-d2a14823e4f5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:27.836571 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a1365c3e-f814-464e-8199-d2a14823e4f5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:27.853841 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a1365c3e-f814-464e-8199-d2a14823e4f5 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1497 microversion: 2.1 time: 0.240733 May 19 12:26:27.855003 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 200/371] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:27 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1497 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:28.889380 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-17b808a7-12a7-4cb2-beff-8033f7c941a9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:28.890336 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-17b808a7-12a7-4cb2-beff-8033f7c941a9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:28.900849 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17b808a7-12a7-4cb2-beff-8033f7c941a9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:28.901303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17b808a7-12a7-4cb2-beff-8033f7c941a9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:28.902102 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17b808a7-12a7-4cb2-beff-8033f7c941a9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:28.902907 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17b808a7-12a7-4cb2-beff-8033f7c941a9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:28.946505 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-17b808a7-12a7-4cb2-beff-8033f7c941a9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:26:29.108625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8bae6083-5418-48bb-81fa-c0a6fb4c0718 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:29.109745 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8bae6083-5418-48bb-81fa-c0a6fb4c0718 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:29.116541 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8bae6083-5418-48bb-81fa-c0a6fb4c0718 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:29.116996 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8bae6083-5418-48bb-81fa-c0a6fb4c0718 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:29.117784 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8bae6083-5418-48bb-81fa-c0a6fb4c0718 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:29.118216 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8bae6083-5418-48bb-81fa-c0a6fb4c0718 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:29.146399 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-8bae6083-5418-48bb-81fa-c0a6fb4c0718 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lazy-loading 'flavor' on Instance uuid d5b2145b-8dcb-4d81-af12-42d1494da298 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:26:29.764725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-17b808a7-12a7-4cb2-beff-8033f7c941a9 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "DELETE /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 204 len: 0 microversion: 2.1 time: 0.881417 May 19 12:26:29.767360 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 172/372] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:26:28 2022] DELETE /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 0 bytes in 886 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:26:29.773818 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8bae6083-5418-48bb-81fa-c0a6fb4c0718 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "POST /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298/action" status: 200 len: 32 microversion: 2.1 time: 0.664232 May 19 12:26:29.773818 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 201/373] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:26:29 2022] POST /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298/action => generated 32 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 12:26:29.777776 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e678516e-db73-4821-a510-8196f32b88cb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:29.778584 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e678516e-db73-4821-a510-8196f32b88cb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:29.784482 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6c25d132-bfcb-44a4-8a9b-5225b9a9bcbf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:29.785111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6c25d132-bfcb-44a4-8a9b-5225b9a9bcbf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:29.786805 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e678516e-db73-4821-a510-8196f32b88cb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:29.787504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e678516e-db73-4821-a510-8196f32b88cb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:29.788353 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e678516e-db73-4821-a510-8196f32b88cb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:29.788801 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e678516e-db73-4821-a510-8196f32b88cb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:29.791967 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c25d132-bfcb-44a4-8a9b-5225b9a9bcbf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:29.792419 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c25d132-bfcb-44a4-8a9b-5225b9a9bcbf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:29.793209 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c25d132-bfcb-44a4-8a9b-5225b9a9bcbf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:29.793642 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c25d132-bfcb-44a4-8a9b-5225b9a9bcbf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:30.094607 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e678516e-db73-4821-a510-8196f32b88cb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:30.104387 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e678516e-db73-4821-a510-8196f32b88cb tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1503 microversion: 2.1 time: 0.331033 May 19 12:26:30.105365 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 173/374] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:29 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:30.112592 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6c25d132-bfcb-44a4-8a9b-5225b9a9bcbf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:30.121448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6c25d132-bfcb-44a4-8a9b-5225b9a9bcbf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.345780 May 19 12:26:30.122084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 202/375] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:29 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:31.125788 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a3a84611-577a-448f-890c-ed34058aaeb2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:31.126434 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a3a84611-577a-448f-890c-ed34058aaeb2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:31.132957 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3a84611-577a-448f-890c-ed34058aaeb2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:31.133442 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3a84611-577a-448f-890c-ed34058aaeb2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:31.134223 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3a84611-577a-448f-890c-ed34058aaeb2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:31.134698 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3a84611-577a-448f-890c-ed34058aaeb2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:31.163378 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-04cbcbb7-b7c2-4b4f-89f2-a1b7959acb1f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:31.164414 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-04cbcbb7-b7c2-4b4f-89f2-a1b7959acb1f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:31.172828 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-04cbcbb7-b7c2-4b4f-89f2-a1b7959acb1f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:31.173436 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-04cbcbb7-b7c2-4b4f-89f2-a1b7959acb1f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:31.174280 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-04cbcbb7-b7c2-4b4f-89f2-a1b7959acb1f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:31.174807 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-04cbcbb7-b7c2-4b4f-89f2-a1b7959acb1f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:31.365746 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a3a84611-577a-448f-890c-ed34058aaeb2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:31.374907 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a3a84611-577a-448f-890c-ed34058aaeb2 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1503 microversion: 2.1 time: 0.253056 May 19 12:26:31.382372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 174/376] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:31 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:31.382571 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-04cbcbb7-b7c2-4b4f-89f2-a1b7959acb1f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:31.387044 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-04cbcbb7-b7c2-4b4f-89f2-a1b7959acb1f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.230141 May 19 12:26:31.387918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 203/377] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:31 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:32.402800 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ec8f9229-bf39-4242-bebe-19be36fdc53d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:32.403685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ec8f9229-bf39-4242-bebe-19be36fdc53d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:32.405277 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-607f03f6-9837-43f1-b7c1-a63c279f2478 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:32.405996 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-607f03f6-9837-43f1-b7c1-a63c279f2478 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:32.411186 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ec8f9229-bf39-4242-bebe-19be36fdc53d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:32.411637 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ec8f9229-bf39-4242-bebe-19be36fdc53d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:32.412440 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ec8f9229-bf39-4242-bebe-19be36fdc53d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:32.412785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-607f03f6-9837-43f1-b7c1-a63c279f2478 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:32.412960 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ec8f9229-bf39-4242-bebe-19be36fdc53d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:32.413326 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-607f03f6-9837-43f1-b7c1-a63c279f2478 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:32.414249 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-607f03f6-9837-43f1-b7c1-a63c279f2478 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:32.414903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-607f03f6-9837-43f1-b7c1-a63c279f2478 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:32.648794 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ec8f9229-bf39-4242-bebe-19be36fdc53d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:32.672370 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-607f03f6-9837-43f1-b7c1-a63c279f2478 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:32.672611 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ec8f9229-bf39-4242-bebe-19be36fdc53d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1503 microversion: 2.1 time: 0.274044 May 19 12:26:32.672611 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 175/378] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:32 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:32.679607 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-607f03f6-9837-43f1-b7c1-a63c279f2478 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.279200 May 19 12:26:32.680970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 204/379] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:32 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:33.057922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-fca138de-7f33-4745-8dc7-35e996b9a3be req-fe643293-49e3-474c-b844-2e31be4758e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991ff17d-491e-4b3c-bc58-92fec10f95ae", "name": "network-vif-deleted", "tag": "3aca7d5e-b386-484d-abce-0842a7bdf3a6"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:33.067250 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-fca138de-7f33-4745-8dc7-35e996b9a3be req-fe643293-49e3-474c-b844-2e31be4758e9 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:33.067886 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-fca138de-7f33-4745-8dc7-35e996b9a3be req-fe643293-49e3-474c-b844-2e31be4758e9 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:33.084262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-fca138de-7f33-4745-8dc7-35e996b9a3be req-fe643293-49e3-474c-b844-2e31be4758e9 service nova] Creating event network-vif-deleted:3aca7d5e-b386-484d-abce-0842a7bdf3a6 for instance 991ff17d-491e-4b3c-bc58-92fec10f95ae on hv-cinder-77819 May 19 12:26:33.089617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-fca138de-7f33-4745-8dc7-35e996b9a3be req-fe643293-49e3-474c-b844-2e31be4758e9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035732 May 19 12:26:33.090247 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 176/380] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:26:33.690999 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-25d3b732-a9ee-4939-9cf2-876760b55241 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:33.691635 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-25d3b732-a9ee-4939-9cf2-876760b55241 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:33.697856 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25d3b732-a9ee-4939-9cf2-876760b55241 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:33.698307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25d3b732-a9ee-4939-9cf2-876760b55241 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:33.699111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25d3b732-a9ee-4939-9cf2-876760b55241 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:33.699540 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25d3b732-a9ee-4939-9cf2-876760b55241 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:33.709352 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bd461371-1fe9-4e19-810b-b1c62245f6fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:33.710154 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bd461371-1fe9-4e19-810b-b1c62245f6fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:33.717414 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd461371-1fe9-4e19-810b-b1c62245f6fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:33.717963 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd461371-1fe9-4e19-810b-b1c62245f6fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:33.719040 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd461371-1fe9-4e19-810b-b1c62245f6fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:33.719576 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd461371-1fe9-4e19-810b-b1c62245f6fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:33.734669 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25d3b732-a9ee-4939-9cf2-876760b55241 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:33.735384 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25d3b732-a9ee-4939-9cf2-876760b55241 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:33.736048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-25d3b732-a9ee-4939-9cf2-876760b55241 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lazy-loading 'fault' on Instance uuid 991ff17d-491e-4b3c-bc58-92fec10f95ae {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:26:33.810687 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-25d3b732-a9ee-4939-9cf2-876760b55241 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa126f7eab4eef8db03374e82a6ab9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f556df7a95041279685098584415ed1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:33.819631 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-25d3b732-a9ee-4939-9cf2-876760b55241 tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 200 len: 1304 microversion: 2.1 time: 0.134055 May 19 12:26:33.820087 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 205/381] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:33 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 1304 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:33.898625 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bd461371-1fe9-4e19-810b-b1c62245f6fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:33.906496 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bd461371-1fe9-4e19-810b-b1c62245f6fc tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.202399 May 19 12:26:33.907103 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 177/382] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:33 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:34.847967 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b59a86a1-4693-406f-9130-0276fe38818d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:34.848940 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b59a86a1-4693-406f-9130-0276fe38818d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] [instance: 991ff17d-491e-4b3c-bc58-92fec10f95ae] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:34.855111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b59a86a1-4693-406f-9130-0276fe38818d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:34.855533 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b59a86a1-4693-406f-9130-0276fe38818d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:34.856310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b59a86a1-4693-406f-9130-0276fe38818d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:34.856762 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b59a86a1-4693-406f-9130-0276fe38818d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:34.870879 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-b59a86a1-4693-406f-9130-0276fe38818d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] HTTP exception thrown: Instance 991ff17d-491e-4b3c-bc58-92fec10f95ae could not be found. May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b59a86a1-4693-406f-9130-0276fe38818d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Request method failure captured: May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae HTTP/1.1 May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjc3e3EdQ-yeX2WeXYlzmcs51699wmoNneRQH3bxOvb1n9k4fLkxX4EzwZGCnWdRe7rzU-RI6IAasLsXwKIGWC-z4IMh3hO9lHwMyteGAL4_I3M2jxH5BNstWqaF5r4Udpkh4_k_G_iAYUfdIt4qR01yxJ8kFW9xWVGnkHKMK0Yrtkw May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 9f556df7a95041279685098584415ed1 May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-VolumesActionsTest-1020965502 May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:26:34.872629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:26:34.874268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9f556df7a95041279685098584415ed1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9f556df7a95041279685098584415ed1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9f556df7a95041279685098584415ed1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9f556df7a95041279685098584415ed1", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:26:34.874268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-VolumesActionsTest-1020965502 May 19 12:26:34.874268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 9f556df7a95041279685098584415ed1 May 19 12:26:34.874268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-VolumesActionsTest-1020965502 May 19 12:26:34.874268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-VolumesActionsTest-1020965502-project May 19 12:26:34.874268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:26:34.874268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:26:34.874268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 7caa126f7eab4eef8db03374e82a6ab9 May 19 12:26:34.874268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-VolumesActionsTest-1020965502-project May 19 12:26:34.874268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:26:34.874268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 991ff17d-491e-4b3c-bc58-92fec10f95ae could not be found. May 19 12:26:34.874268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '991ff17d-491e-4b3c-bc58-92fec10f95ae'} May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 991ff17d-491e-4b3c-bc58-92fec10f95ae could not be found. May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:26:34.875114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 991ff17d-491e-4b3c-bc58-92fec10f95ae could not be found. May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 991ff17d-491e-4b3c-bc58-92fec10f95ae could not be found. May 19 12:26:34.876622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:26:34.877721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b59a86a1-4693-406f-9130-0276fe38818d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] Returning 404 to user: Instance 991ff17d-491e-4b3c-bc58-92fec10f95ae could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:26:34.877721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b59a86a1-4693-406f-9130-0276fe38818d tempest-VolumesActionsTest-1020965502 tempest-VolumesActionsTest-1020965502-project] 10.222.0.57 "GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae" status: 404 len: 111 microversion: 2.1 time: 0.030014 May 19 12:26:34.877721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 206/383] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:34 2022] GET /compute/v2.1/servers/991ff17d-491e-4b3c-bc58-92fec10f95ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:26:34.924862 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-eb27f88c-28a5-4f32-97f4-66f0411bd102 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:34.927251 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-eb27f88c-28a5-4f32-97f4-66f0411bd102 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:34.934311 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eb27f88c-28a5-4f32-97f4-66f0411bd102 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:34.934788 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eb27f88c-28a5-4f32-97f4-66f0411bd102 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:34.938099 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eb27f88c-28a5-4f32-97f4-66f0411bd102 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:34.938099 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eb27f88c-28a5-4f32-97f4-66f0411bd102 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:35.082366 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-eb27f88c-28a5-4f32-97f4-66f0411bd102 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:35.090417 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-eb27f88c-28a5-4f32-97f4-66f0411bd102 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.170015 May 19 12:26:35.091019 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 178/384] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:34 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:36.107298 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-15e1731b-5d88-4d45-a817-2362ea29354f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:36.107963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-15e1731b-5d88-4d45-a817-2362ea29354f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:36.114318 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-15e1731b-5d88-4d45-a817-2362ea29354f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:36.114813 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-15e1731b-5d88-4d45-a817-2362ea29354f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:36.115661 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-15e1731b-5d88-4d45-a817-2362ea29354f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:36.116102 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-15e1731b-5d88-4d45-a817-2362ea29354f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:36.267921 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-15e1731b-5d88-4d45-a817-2362ea29354f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:36.286267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-15e1731b-5d88-4d45-a817-2362ea29354f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.182921 May 19 12:26:36.288076 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 207/385] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:36 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:37.306878 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8358b02e-b811-4fac-b624-9d57fc9604ab tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:37.311707 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8358b02e-b811-4fac-b624-9d57fc9604ab tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:37.314528 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8358b02e-b811-4fac-b624-9d57fc9604ab tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:37.314983 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8358b02e-b811-4fac-b624-9d57fc9604ab tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:37.315763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8358b02e-b811-4fac-b624-9d57fc9604ab tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:37.316196 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8358b02e-b811-4fac-b624-9d57fc9604ab tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:37.319378 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:37.481292 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8358b02e-b811-4fac-b624-9d57fc9604ab tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:37.492355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8358b02e-b811-4fac-b624-9d57fc9604ab tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.192036 May 19 12:26:37.492953 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 179/386] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:37 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:38.512246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8fe63c65-354e-4a92-9306-d91eb5ed716b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:38.513005 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8fe63c65-354e-4a92-9306-d91eb5ed716b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:38.520303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8fe63c65-354e-4a92-9306-d91eb5ed716b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:38.520813 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8fe63c65-354e-4a92-9306-d91eb5ed716b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:38.521663 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8fe63c65-354e-4a92-9306-d91eb5ed716b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:38.522238 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8fe63c65-354e-4a92-9306-d91eb5ed716b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:38.724349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8fe63c65-354e-4a92-9306-d91eb5ed716b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:38.732821 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8fe63c65-354e-4a92-9306-d91eb5ed716b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.224996 May 19 12:26:38.733422 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 208/387] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:38 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:39.751913 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-90f102a0-46ef-4c8a-aa85-ec0e5ce51939 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:39.752531 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-90f102a0-46ef-4c8a-aa85-ec0e5ce51939 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:39.759758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-90f102a0-46ef-4c8a-aa85-ec0e5ce51939 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:39.760251 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-90f102a0-46ef-4c8a-aa85-ec0e5ce51939 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:39.761085 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-90f102a0-46ef-4c8a-aa85-ec0e5ce51939 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:39.761537 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-90f102a0-46ef-4c8a-aa85-ec0e5ce51939 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:39.955265 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-90f102a0-46ef-4c8a-aa85-ec0e5ce51939 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:39.964964 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-90f102a0-46ef-4c8a-aa85-ec0e5ce51939 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.218560 May 19 12:26:39.965561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 180/388] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:39 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:40.982195 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a6987482-4b8d-4c53-abd8-d4aed4c7afe4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:40.982942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a6987482-4b8d-4c53-abd8-d4aed4c7afe4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:40.989425 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a6987482-4b8d-4c53-abd8-d4aed4c7afe4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:40.989879 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a6987482-4b8d-4c53-abd8-d4aed4c7afe4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:40.991544 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a6987482-4b8d-4c53-abd8-d4aed4c7afe4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:40.991544 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a6987482-4b8d-4c53-abd8-d4aed4c7afe4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:41.132901 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a6987482-4b8d-4c53-abd8-d4aed4c7afe4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:41.142022 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a6987482-4b8d-4c53-abd8-d4aed4c7afe4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.163705 May 19 12:26:41.142638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 209/389] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:40 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:42.160530 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f238726c-6fd2-45e4-bb6e-8fd232a97458 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:42.161124 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f238726c-6fd2-45e4-bb6e-8fd232a97458 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:42.168388 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f238726c-6fd2-45e4-bb6e-8fd232a97458 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:42.168822 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f238726c-6fd2-45e4-bb6e-8fd232a97458 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:42.170387 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f238726c-6fd2-45e4-bb6e-8fd232a97458 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:42.171019 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f238726c-6fd2-45e4-bb6e-8fd232a97458 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:42.323540 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f238726c-6fd2-45e4-bb6e-8fd232a97458 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:42.349680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f238726c-6fd2-45e4-bb6e-8fd232a97458 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.192558 May 19 12:26:42.350293 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 181/390] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:42 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:43.378367 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8f30588d-93cf-4019-8457-4cf112c71ea3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:43.379505 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8f30588d-93cf-4019-8457-4cf112c71ea3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:43.392313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8f30588d-93cf-4019-8457-4cf112c71ea3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:43.393320 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8f30588d-93cf-4019-8457-4cf112c71ea3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:43.395400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8f30588d-93cf-4019-8457-4cf112c71ea3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:43.396558 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8f30588d-93cf-4019-8457-4cf112c71ea3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:43.798339 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8f30588d-93cf-4019-8457-4cf112c71ea3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:43.831789 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:43.858707 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8f30588d-93cf-4019-8457-4cf112c71ea3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.483170 May 19 12:26:43.868019 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 210/391] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:43 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:44.885673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-44b9495f-4f6a-4a5e-b6a8-2891dadf1379 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:44.886985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-44b9495f-4f6a-4a5e-b6a8-2891dadf1379 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:44.891191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:44.902716 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-44b9495f-4f6a-4a5e-b6a8-2891dadf1379 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:44.906321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-44b9495f-4f6a-4a5e-b6a8-2891dadf1379 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:44.907456 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-44b9495f-4f6a-4a5e-b6a8-2891dadf1379 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:44.910675 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-44b9495f-4f6a-4a5e-b6a8-2891dadf1379 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:45.190299 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-44b9495f-4f6a-4a5e-b6a8-2891dadf1379 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:45.204254 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-44b9495f-4f6a-4a5e-b6a8-2891dadf1379 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.323322 May 19 12:26:45.210660 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 182/392] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:44 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:46.227538 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-629f2341-fc4f-42f8-82c0-cfbd6705084f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:46.233070 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-629f2341-fc4f-42f8-82c0-cfbd6705084f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:46.241485 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-629f2341-fc4f-42f8-82c0-cfbd6705084f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:46.242038 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-629f2341-fc4f-42f8-82c0-cfbd6705084f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:46.243168 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-629f2341-fc4f-42f8-82c0-cfbd6705084f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:46.243726 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-629f2341-fc4f-42f8-82c0-cfbd6705084f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:46.501794 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-629f2341-fc4f-42f8-82c0-cfbd6705084f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:46.511431 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-629f2341-fc4f-42f8-82c0-cfbd6705084f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.292798 May 19 12:26:46.512062 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 211/393] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:46 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:47.537662 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-511b4fe0-d6fe-4f68-92b7-cc8af20f4658 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:47.538489 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-511b4fe0-d6fe-4f68-92b7-cc8af20f4658 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:47.548540 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-511b4fe0-d6fe-4f68-92b7-cc8af20f4658 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:47.549658 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-511b4fe0-d6fe-4f68-92b7-cc8af20f4658 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:47.551449 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-511b4fe0-d6fe-4f68-92b7-cc8af20f4658 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:47.552303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-511b4fe0-d6fe-4f68-92b7-cc8af20f4658 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:47.774624 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-511b4fe0-d6fe-4f68-92b7-cc8af20f4658 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:47.785890 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-511b4fe0-d6fe-4f68-92b7-cc8af20f4658 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.252408 May 19 12:26:47.802677 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 183/394] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:47 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:48.808239 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b7024159-7094-4c8b-b114-4312056315d1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:48.809985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b7024159-7094-4c8b-b114-4312056315d1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:48.818292 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b7024159-7094-4c8b-b114-4312056315d1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:48.818763 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b7024159-7094-4c8b-b114-4312056315d1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:48.819537 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b7024159-7094-4c8b-b114-4312056315d1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:48.820244 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b7024159-7094-4c8b-b114-4312056315d1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:49.058257 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b7024159-7094-4c8b-b114-4312056315d1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:49.071834 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b7024159-7094-4c8b-b114-4312056315d1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.267698 May 19 12:26:49.073664 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 212/395] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:48 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:50.092752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b8a6c5ed-094d-4b10-beb7-57838048e435 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:50.093385 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b8a6c5ed-094d-4b10-beb7-57838048e435 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:50.105011 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8a6c5ed-094d-4b10-beb7-57838048e435 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:50.105733 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8a6c5ed-094d-4b10-beb7-57838048e435 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:50.107546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8a6c5ed-094d-4b10-beb7-57838048e435 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:50.108232 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b8a6c5ed-094d-4b10-beb7-57838048e435 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:50.323926 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b8a6c5ed-094d-4b10-beb7-57838048e435 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:50.335714 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b8a6c5ed-094d-4b10-beb7-57838048e435 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.249537 May 19 12:26:50.336979 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 184/396] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:50 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:51.353968 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fa680434-21ca-4b01-837b-82e967f2153e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:51.354539 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fa680434-21ca-4b01-837b-82e967f2153e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:51.369039 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa680434-21ca-4b01-837b-82e967f2153e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:51.369500 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa680434-21ca-4b01-837b-82e967f2153e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:51.370322 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa680434-21ca-4b01-837b-82e967f2153e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:51.370809 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa680434-21ca-4b01-837b-82e967f2153e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:51.705895 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fa680434-21ca-4b01-837b-82e967f2153e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:51.723587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fa680434-21ca-4b01-837b-82e967f2153e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.374010 May 19 12:26:51.727103 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 213/397] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:51 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:52.752431 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-44f096a7-3793-49c2-920b-7a705cb317c0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:52.753940 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-44f096a7-3793-49c2-920b-7a705cb317c0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:52.795873 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-44f096a7-3793-49c2-920b-7a705cb317c0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:52.804837 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-44f096a7-3793-49c2-920b-7a705cb317c0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:52.839847 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-44f096a7-3793-49c2-920b-7a705cb317c0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:52.839847 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-44f096a7-3793-49c2-920b-7a705cb317c0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:53.058562 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-44f096a7-3793-49c2-920b-7a705cb317c0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:53.071628 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-44f096a7-3793-49c2-920b-7a705cb317c0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.332143 May 19 12:26:53.074370 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 185/398] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:52 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:26:54.103941 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9d598b57-f2eb-4fb9-a467-94eba51c2913 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:54.105265 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9d598b57-f2eb-4fb9-a467-94eba51c2913 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:54.118034 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9d598b57-f2eb-4fb9-a467-94eba51c2913 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:54.145547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9d598b57-f2eb-4fb9-a467-94eba51c2913 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:54.145547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9d598b57-f2eb-4fb9-a467-94eba51c2913 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:54.145547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9d598b57-f2eb-4fb9-a467-94eba51c2913 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:54.385296 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9d598b57-f2eb-4fb9-a467-94eba51c2913 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:54.397330 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9d598b57-f2eb-4fb9-a467-94eba51c2913 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1502 microversion: 2.1 time: 0.300784 May 19 12:26:54.398730 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 214/399] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:54 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1502 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:54.431646 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e6a53a44-01c5-4fe0-9196-6ae1b3be3c61 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b4361ed-3cba-46ac-aa3f-08616901f807"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:54.439900 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e6a53a44-01c5-4fe0-9196-6ae1b3be3c61 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:54.442479 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6a53a44-01c5-4fe0-9196-6ae1b3be3c61 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:54.443178 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6a53a44-01c5-4fe0-9196-6ae1b3be3c61 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:54.446549 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6a53a44-01c5-4fe0-9196-6ae1b3be3c61 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:54.447218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6a53a44-01c5-4fe0-9196-6ae1b3be3c61 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:54.560417 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-e6a53a44-01c5-4fe0-9196-6ae1b3be3c61 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] HTTP exception thrown: Cannot 'attach_volume' instance d5b2145b-8dcb-4d81-af12-42d1494da298 while it is in vm_state rescued May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e6a53a44-01c5-4fe0-9196-6ae1b3be3c61 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Request method failure captured: May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: POST /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298/os-volume_attachments HTTP/1.1 May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 74 May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjb6x7UOYCybG9-cKm4BV2RSK8mO4iQRuFsCG79T52SfVrJnf6u9-MO1kqqebqKlEz5jWPbyljj0HdBHu4m_dNASD-FoSZU2o4r_16ajVcR7V7lzHTkKXiXAvVeH3F5QXHk3Uva_ii2xPzNguR5JfCHlU4VxOadvL0aWPLAnKNBIeE0 May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: d9e96ed4a3b5430298605d709d353f6e May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:26:54.568985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:26:54.586962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d9e96ed4a3b5430298605d709d353f6e", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:26:54.586962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:26:54.586962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: d9e96ed4a3b5430298605d709d353f6e May 19 12:26:54.586962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:26:54.586962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-ServerRescueNegativeTestJSON-1726578429-project May 19 12:26:54.586962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:26:54.586962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:26:54.586962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 5c35bd3640694b0dbce13c713fd68306 May 19 12:26:54.586962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726578429-project May 19 12:26:54.586962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: May 19 12:26:54.586962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {"volumeAttachment": {"volumeId": "6b4361ed-3cba-46ac-aa3f-08616901f807"}} May 19 12:26:54.586962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Cannot 'attach_volume' instance d5b2145b-8dcb-4d81-af12-42d1494da298 while it is in vm_state rescued May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'server_id': 'd5b2145b-8dcb-4d81-af12-42d1494da298', 'body': {'volumeAttachment': {'volumeId': '6b4361ed-3cba-46ac-aa3f-08616901f807'}}} May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d5b2145b-8dcb-4d81-af12-42d1494da298 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:26:54.588763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d5b2145b-8dcb-4d81-af12-42d1494da298 while it is in vm_state rescued May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:26:54.591557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:26:54.593838 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:26:54.593838 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:26:54.593838 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d5b2145b-8dcb-4d81-af12-42d1494da298 while it is in vm_state rescued May 19 12:26:54.593838 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:26:54.593838 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e6a53a44-01c5-4fe0-9196-6ae1b3be3c61 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Returning 409 to user: Cannot 'attach_volume' instance d5b2145b-8dcb-4d81-af12-42d1494da298 while it is in vm_state rescued {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:26:54.593838 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e6a53a44-01c5-4fe0-9196-6ae1b3be3c61 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "POST /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.152504 May 19 12:26:54.593838 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 186/400] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:26:54 2022] POST /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298/os-volume_attachments => generated 152 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 19 12:26:54.602051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a3221f46-2c1f-434b-881f-00646deaacee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:26:54.603153 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a3221f46-2c1f-434b-881f-00646deaacee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:54.617940 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a3221f46-2c1f-434b-881f-00646deaacee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:54.618738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a3221f46-2c1f-434b-881f-00646deaacee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:54.620308 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a3221f46-2c1f-434b-881f-00646deaacee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:54.621235 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a3221f46-2c1f-434b-881f-00646deaacee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:54.956918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a3221f46-2c1f-434b-881f-00646deaacee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "POST /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298/action" status: 202 len: 0 microversion: 2.1 time: 0.367666 May 19 12:26:54.968077 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 215/401] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:26:54 2022] POST /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 12:26:54.974513 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-79f9a0fd-54c5-4cf8-a00a-3c09f3954a71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:54.980778 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-79f9a0fd-54c5-4cf8-a00a-3c09f3954a71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:54.998401 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-79f9a0fd-54c5-4cf8-a00a-3c09f3954a71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:54.998941 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-79f9a0fd-54c5-4cf8-a00a-3c09f3954a71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:54.999748 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-79f9a0fd-54c5-4cf8-a00a-3c09f3954a71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:55.002008 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-79f9a0fd-54c5-4cf8-a00a-3c09f3954a71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:55.329776 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-79f9a0fd-54c5-4cf8-a00a-3c09f3954a71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:55.380617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-79f9a0fd-54c5-4cf8-a00a-3c09f3954a71 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1510 microversion: 2.1 time: 0.410842 May 19 12:26:55.382516 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 187/402] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:54 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1510 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:56.407026 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-00b9167a-a23a-4c42-974a-ed1003669aeb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:56.407459 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-00b9167a-a23a-4c42-974a-ed1003669aeb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:56.415237 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-00b9167a-a23a-4c42-974a-ed1003669aeb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:56.416094 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-00b9167a-a23a-4c42-974a-ed1003669aeb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:56.417249 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-00b9167a-a23a-4c42-974a-ed1003669aeb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:56.418564 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-00b9167a-a23a-4c42-974a-ed1003669aeb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:56.777615 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-00b9167a-a23a-4c42-974a-ed1003669aeb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:56.791569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-00b9167a-a23a-4c42-974a-ed1003669aeb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1510 microversion: 2.1 time: 0.391829 May 19 12:26:56.792690 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 216/403] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:56 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1510 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:57.818791 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e72fe11d-748d-412a-bb54-c50dd937da45 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:57.819340 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e72fe11d-748d-412a-bb54-c50dd937da45 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:57.840494 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e72fe11d-748d-412a-bb54-c50dd937da45 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:57.844275 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e72fe11d-748d-412a-bb54-c50dd937da45 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:57.845402 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e72fe11d-748d-412a-bb54-c50dd937da45 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:57.846060 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e72fe11d-748d-412a-bb54-c50dd937da45 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:58.276887 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e72fe11d-748d-412a-bb54-c50dd937da45 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:58.293315 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e72fe11d-748d-412a-bb54-c50dd937da45 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1510 microversion: 2.1 time: 0.482835 May 19 12:26:58.304442 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 188/404] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:57 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1510 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:26:59.327264 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fa0c6494-a470-4122-9c7e-9144ad0505f0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:26:59.327993 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fa0c6494-a470-4122-9c7e-9144ad0505f0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:26:59.337338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=38 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:26:59.341553 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa0c6494-a470-4122-9c7e-9144ad0505f0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:59.342320 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa0c6494-a470-4122-9c7e-9144ad0505f0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:59.348717 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa0c6494-a470-4122-9c7e-9144ad0505f0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:26:59.350736 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa0c6494-a470-4122-9c7e-9144ad0505f0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:26:59.719183 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fa0c6494-a470-4122-9c7e-9144ad0505f0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:26:59.727933 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fa0c6494-a470-4122-9c7e-9144ad0505f0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1510 microversion: 2.1 time: 0.405345 May 19 12:26:59.729871 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 217/405] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:26:59 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:00.764816 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8d79bbc0-901d-4c38-9f1d-fd477c8b4bbd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:00.764816 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8d79bbc0-901d-4c38-9f1d-fd477c8b4bbd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:00.776794 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8d79bbc0-901d-4c38-9f1d-fd477c8b4bbd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:00.777686 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8d79bbc0-901d-4c38-9f1d-fd477c8b4bbd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:00.779968 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8d79bbc0-901d-4c38-9f1d-fd477c8b4bbd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:00.781137 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8d79bbc0-901d-4c38-9f1d-fd477c8b4bbd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:00.979807 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8d79bbc0-901d-4c38-9f1d-fd477c8b4bbd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:00.988825 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8d79bbc0-901d-4c38-9f1d-fd477c8b4bbd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1510 microversion: 2.1 time: 0.237362 May 19 12:27:00.990065 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 189/406] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:00 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:02.016458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-55dd8333-5fa7-42b1-bc7c-4bce5f6e67a2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:02.017078 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-55dd8333-5fa7-42b1-bc7c-4bce5f6e67a2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:02.024905 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55dd8333-5fa7-42b1-bc7c-4bce5f6e67a2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:02.025469 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55dd8333-5fa7-42b1-bc7c-4bce5f6e67a2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:02.026473 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55dd8333-5fa7-42b1-bc7c-4bce5f6e67a2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:02.027643 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55dd8333-5fa7-42b1-bc7c-4bce5f6e67a2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:02.311453 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-55dd8333-5fa7-42b1-bc7c-4bce5f6e67a2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:02.337511 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-55dd8333-5fa7-42b1-bc7c-4bce5f6e67a2 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1516 microversion: 2.1 time: 0.325295 May 19 12:27:02.352235 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 218/407] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:02 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1516 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:05.615020 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-eeca213d-8fd8-4072-a4bf-cbc6640ad37d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Action: 'create', calling method: .version_select at 0x7fd45504b1f0>, body: {"keypair": {"name": "tempest-keypair-1454104303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoxJmvlPkqXvDVvImyzQsgFxr8Q5C1uYltLhlt6+I4q5os5kT53Aw539jGs0Byb+b5wkJzuPYIbA/dtHyuRwIVs8yZBMlrSfmR5+pPjy+z1jdkIWxYXOHjmlT/pPe6wIg=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:05.659957 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-eeca213d-8fd8-4072-a4bf-cbc6640ad37d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Getting quotas for project d9e96ed4a3b5430298605d709d353f6e. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:27:05.668123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-eeca213d-8fd8-4072-a4bf-cbc6640ad37d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Getting quotas for user 5c35bd3640694b0dbce13c713fd68306 and project d9e96ed4a3b5430298605d709d353f6e. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:27:05.784264 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-eeca213d-8fd8-4072-a4bf-cbc6640ad37d tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174695 May 19 12:27:05.785519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 190/408] 10.222.0.57 () {60 vars in 1158 bytes} [Thu May 19 12:27:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:10.854142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2072959461", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be7a1bb6-7423-463b-a0ab-52779c3ad619"}], "security_groups": [{"name": "tempest-securitygroup--633243206"}], "key_name": "tempest-keypair-1454104303", "user_data": "}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:11.163143 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.network.neutron [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] validate_networks() for [('be7a1bb6-7423-463b-a0ab-52779c3ad619', None, None, None, None, None)] {{(pid=118112) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:27:11.736464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Flavor limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:27:11.736975 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Image limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:27:11.737602 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Flavor pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:27:11.738184 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Image pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:27:11.738635 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:27:11.749064 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:11.749506 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:11.751179 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:11.751774 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:11.774389 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Getting quotas for project d9e96ed4a3b5430298605d709d353f6e. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:27:11.780520 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Getting quotas for user 5c35bd3640694b0dbce13c713fd68306 and project d9e96ed4a3b5430298605d709d353f6e. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:27:11.799453 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Going to run 1 instances... {{(pid=118112) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:27:11.802953 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:27:12.066103 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1ad6401a-80fd-42d3-9fc4-b9b7c63c0135 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.246688 May 19 12:27:12.067569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 219/409] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:27:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:27:12.078726 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9a89280f-3072-4cc2-a3aa-b8e9530e8743 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:12.079997 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9a89280f-3072-4cc2-a3aa-b8e9530e8743 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:12.082687 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=63 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:12.167502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9a89280f-3072-4cc2-a3aa-b8e9530e8743 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:12.178315 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9a89280f-3072-4cc2-a3aa-b8e9530e8743 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1246 microversion: 2.1 time: 0.104181 May 19 12:27:12.187006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 191/410] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:12 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1246 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:13.197661 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-752da486-e8ba-4589-8033-c7adcb979199 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:13.198447 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-752da486-e8ba-4589-8033-c7adcb979199 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:13.278866 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-752da486-e8ba-4589-8033-c7adcb979199 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:13.294803 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-752da486-e8ba-4589-8033-c7adcb979199 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1246 microversion: 2.1 time: 0.095460 May 19 12:27:13.294803 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 220/411] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:13 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:14.308143 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dcd32b8f-5739-4d9a-b10b-924b986ed825 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:14.309099 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dcd32b8f-5739-4d9a-b10b-924b986ed825 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:14.320278 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dcd32b8f-5739-4d9a-b10b-924b986ed825 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:14.323620 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dcd32b8f-5739-4d9a-b10b-924b986ed825 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:14.325690 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dcd32b8f-5739-4d9a-b10b-924b986ed825 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:14.326573 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dcd32b8f-5739-4d9a-b10b-924b986ed825 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:14.460516 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dcd32b8f-5739-4d9a-b10b-924b986ed825 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:14.472438 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dcd32b8f-5739-4d9a-b10b-924b986ed825 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1242 microversion: 2.1 time: 0.168272 May 19 12:27:14.473672 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 192/412] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:14 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1242 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:15.491052 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-7597f3ae-76c0-419a-a9cb-81312bc5c868 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:15.492529 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-7597f3ae-76c0-419a-a9cb-81312bc5c868 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:15.505404 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7597f3ae-76c0-419a-a9cb-81312bc5c868 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:15.507215 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7597f3ae-76c0-419a-a9cb-81312bc5c868 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:15.508252 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7597f3ae-76c0-419a-a9cb-81312bc5c868 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:15.508852 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7597f3ae-76c0-419a-a9cb-81312bc5c868 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:15.614656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-7597f3ae-76c0-419a-a9cb-81312bc5c868 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:15.626888 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-7597f3ae-76c0-419a-a9cb-81312bc5c868 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1298 microversion: 2.1 time: 0.139066 May 19 12:27:15.629108 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 221/413] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:15 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1298 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:16.647679 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a498e82e-751f-4cbd-9ee9-773ecc44bc84 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:16.649159 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a498e82e-751f-4cbd-9ee9-773ecc44bc84 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:16.663615 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:16.675100 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a498e82e-751f-4cbd-9ee9-773ecc44bc84 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:16.676784 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a498e82e-751f-4cbd-9ee9-773ecc44bc84 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:16.677975 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a498e82e-751f-4cbd-9ee9-773ecc44bc84 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:16.681160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a498e82e-751f-4cbd-9ee9-773ecc44bc84 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:16.789148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a498e82e-751f-4cbd-9ee9-773ecc44bc84 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:16.800573 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a498e82e-751f-4cbd-9ee9-773ecc44bc84 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1306 microversion: 2.1 time: 0.157094 May 19 12:27:16.813416 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 193/414] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:16 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1306 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:17.833548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-53bcb027-6fb0-4f27-8ade-963c2f95f904 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:17.837940 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-53bcb027-6fb0-4f27-8ade-963c2f95f904 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:17.861536 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53bcb027-6fb0-4f27-8ade-963c2f95f904 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:17.863214 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53bcb027-6fb0-4f27-8ade-963c2f95f904 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:17.864253 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53bcb027-6fb0-4f27-8ade-963c2f95f904 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:17.873139 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53bcb027-6fb0-4f27-8ade-963c2f95f904 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:18.296754 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-53bcb027-6fb0-4f27-8ade-963c2f95f904 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:18.305534 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-53bcb027-6fb0-4f27-8ade-963c2f95f904 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1371 microversion: 2.1 time: 0.488944 May 19 12:27:18.307455 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 222/415] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:17 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1371 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:19.330296 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-565c014d-1679-424d-8e3a-00bbe3e81b81 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:19.332381 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-565c014d-1679-424d-8e3a-00bbe3e81b81 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:19.354965 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-565c014d-1679-424d-8e3a-00bbe3e81b81 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:19.358257 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-565c014d-1679-424d-8e3a-00bbe3e81b81 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:19.366168 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-565c014d-1679-424d-8e3a-00bbe3e81b81 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:19.367915 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-565c014d-1679-424d-8e3a-00bbe3e81b81 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:19.745053 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-565c014d-1679-424d-8e3a-00bbe3e81b81 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:19.773389 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-565c014d-1679-424d-8e3a-00bbe3e81b81 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1371 microversion: 2.1 time: 0.451262 May 19 12:27:19.778663 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 194/416] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:19 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1371 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:19.960185 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-58af0c08-1723-4ae7-8971-9117a503e28c req-fbb93aee-f2b2-482e-8b75-180fa26fe7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7fd7551-12f3-4549-9429-3a9ecd8dd150", "tag": "849d8b72-d2dd-410e-89b0-e5a60ec6340e"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:19.979571 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-58af0c08-1723-4ae7-8971-9117a503e28c req-fbb93aee-f2b2-482e-8b75-180fa26fe7c0 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:19.981062 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-58af0c08-1723-4ae7-8971-9117a503e28c req-fbb93aee-f2b2-482e-8b75-180fa26fe7c0 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:19.989092 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:20.008763 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-58af0c08-1723-4ae7-8971-9117a503e28c req-fbb93aee-f2b2-482e-8b75-180fa26fe7c0 service nova] Creating event network-changed:849d8b72-d2dd-410e-89b0-e5a60ec6340e for instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 on hv-cinder-77819 May 19 12:27:20.020433 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-58af0c08-1723-4ae7-8971-9117a503e28c req-fbb93aee-f2b2-482e-8b75-180fa26fe7c0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068412 May 19 12:27:20.020433 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 223/417] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:20.801694 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c1c22f1f-073a-45f0-904d-46f82871303c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:20.803106 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c1c22f1f-073a-45f0-904d-46f82871303c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:20.810606 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c1c22f1f-073a-45f0-904d-46f82871303c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:20.811149 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c1c22f1f-073a-45f0-904d-46f82871303c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:20.812004 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c1c22f1f-073a-45f0-904d-46f82871303c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:20.812659 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c1c22f1f-073a-45f0-904d-46f82871303c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:21.098041 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c1c22f1f-073a-45f0-904d-46f82871303c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:21.112846 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c1c22f1f-073a-45f0-904d-46f82871303c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1371 microversion: 2.1 time: 0.315516 May 19 12:27:21.117034 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 195/418] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:20 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1371 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:22.145959 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:22.153226 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-94c5e243-432e-4f40-9b62-27a28f4ce95b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:22.154330 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-94c5e243-432e-4f40-9b62-27a28f4ce95b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:22.162130 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-94c5e243-432e-4f40-9b62-27a28f4ce95b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:22.162966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-94c5e243-432e-4f40-9b62-27a28f4ce95b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:22.163987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-94c5e243-432e-4f40-9b62-27a28f4ce95b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:22.164442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-94c5e243-432e-4f40-9b62-27a28f4ce95b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:22.325801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-94c5e243-432e-4f40-9b62-27a28f4ce95b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:22.333536 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-94c5e243-432e-4f40-9b62-27a28f4ce95b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1371 microversion: 2.1 time: 0.188691 May 19 12:27:22.334106 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 224/419] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:22 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:23.361721 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4e8be021-7e86-4c68-b71a-ee32a0b76812 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:23.363116 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4e8be021-7e86-4c68-b71a-ee32a0b76812 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:23.369451 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:23.377157 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4e8be021-7e86-4c68-b71a-ee32a0b76812 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:23.378278 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4e8be021-7e86-4c68-b71a-ee32a0b76812 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:23.380115 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4e8be021-7e86-4c68-b71a-ee32a0b76812 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:23.381267 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4e8be021-7e86-4c68-b71a-ee32a0b76812 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:23.685992 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4e8be021-7e86-4c68-b71a-ee32a0b76812 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:23.695189 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4e8be021-7e86-4c68-b71a-ee32a0b76812 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1371 microversion: 2.1 time: 0.342826 May 19 12:27:23.696395 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 196/420] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:23 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:23.979683 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=8 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:23.985544 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1d9d81d9-298f-4b1f-aac8-8e7f33a618fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:23.986279 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1d9d81d9-298f-4b1f-aac8-8e7f33a618fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:23.993850 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1d9d81d9-298f-4b1f-aac8-8e7f33a618fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:23.994304 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1d9d81d9-298f-4b1f-aac8-8e7f33a618fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:23.995121 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1d9d81d9-298f-4b1f-aac8-8e7f33a618fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:23.995590 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1d9d81d9-298f-4b1f-aac8-8e7f33a618fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:24.023989 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1d9d81d9-298f-4b1f-aac8-8e7f33a618fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/ips" status: 200 len: 145 microversion: 2.1 time: 0.046919 May 19 12:27:24.030836 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 225/421] 10.222.0.57 () {58 vars in 1247 bytes} [Thu May 19 12:27:23 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/ips => generated 145 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:24.728347 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f6d213a9-75a6-4ede-bbfb-2472f9843fac tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:24.729100 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f6d213a9-75a6-4ede-bbfb-2472f9843fac tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:24.737620 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f6d213a9-75a6-4ede-bbfb-2472f9843fac tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:24.738318 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f6d213a9-75a6-4ede-bbfb-2472f9843fac tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:24.739325 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f6d213a9-75a6-4ede-bbfb-2472f9843fac tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:24.739744 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f6d213a9-75a6-4ede-bbfb-2472f9843fac tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:24.993784 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f6d213a9-75a6-4ede-bbfb-2472f9843fac tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:25.016736 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f6d213a9-75a6-4ede-bbfb-2472f9843fac tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1371 microversion: 2.1 time: 0.292176 May 19 12:27:25.032403 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 197/422] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:24 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:26.049227 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-99dc76b4-c08b-47f4-881c-d50eaea74d3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:26.050712 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-99dc76b4-c08b-47f4-881c-d50eaea74d3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:26.061818 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-99dc76b4-c08b-47f4-881c-d50eaea74d3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:26.062268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-99dc76b4-c08b-47f4-881c-d50eaea74d3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:26.063073 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-99dc76b4-c08b-47f4-881c-d50eaea74d3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:26.063553 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-99dc76b4-c08b-47f4-881c-d50eaea74d3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:26.233735 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-99dc76b4-c08b-47f4-881c-d50eaea74d3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:26.241420 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-99dc76b4-c08b-47f4-881c-d50eaea74d3e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1371 microversion: 2.1 time: 0.196458 May 19 12:27:26.242030 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 226/423] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:26 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:27.259324 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5408354e-3d12-44f8-975a-ced7aa77c9b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:27.259960 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5408354e-3d12-44f8-975a-ced7aa77c9b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:27.267750 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5408354e-3d12-44f8-975a-ced7aa77c9b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:27.268151 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5408354e-3d12-44f8-975a-ced7aa77c9b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:27.268825 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5408354e-3d12-44f8-975a-ced7aa77c9b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:27.269264 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5408354e-3d12-44f8-975a-ced7aa77c9b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:27.428458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5408354e-3d12-44f8-975a-ced7aa77c9b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:27.437614 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5408354e-3d12-44f8-975a-ced7aa77c9b3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1371 microversion: 2.1 time: 0.182113 May 19 12:27:27.438478 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 198/424] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:27 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:27.884125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ff064e7a-9f3d-4d7a-bc76-f0e3616d2590 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Action: 'create', calling method: .version_select at 0x7fd4563c3940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-442604293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLPWWb+4c4wH95azQE0DdG7HaMN1oRvg+zSxRAG8zosABRjVvH068biesdad4azt3229VRKpMotAj/D8MVTKoVzUrO7MSScg/SezqJ+kFbH7tC9J8rfx7cDuKKfSkHYNg=="}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:27.904909 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-ff064e7a-9f3d-4d7a-bc76-f0e3616d2590 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Getting quotas for project 3be6c3cdf062493184ab67ec3ec9940f. Resources: {'key_pairs'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:27:27.908850 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-ff064e7a-9f3d-4d7a-bc76-f0e3616d2590 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Getting quotas for user 3cf7a5b535234632bb00a9b87ceb5354 and project 3be6c3cdf062493184ab67ec3ec9940f. Resources: {'key_pairs'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:27:28.024123 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ff064e7a-9f3d-4d7a-bc76-f0e3616d2590 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.143816 May 19 12:27:28.025507 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 227/425] 10.222.0.57 () {60 vars in 1158 bytes} [Thu May 19 12:27:27 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:28.141209 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-391597055", "imageRef": "214a82bf-71a6-43a2-94a0-792ec7d5f308", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-442604293", "networks": [{"uuid": "fd910aa7-5907-427f-8250-4593b656fe8d"}]}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:28.196079 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] validate_networks() for [('fd910aa7-5907-427f-8250-4593b656fe8d', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:27:28.445016 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6e389872-38fb-4c75-a5b8-acc23428ddd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86aa3f78-0a52-47b4-a7a7-faf4c0bc8b95"}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:28.446186 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6e389872-38fb-4c75-a5b8-acc23428ddd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:28.453910 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e389872-38fb-4c75-a5b8-acc23428ddd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:28.454362 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e389872-38fb-4c75-a5b8-acc23428ddd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:28.455453 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e389872-38fb-4c75-a5b8-acc23428ddd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:28.455908 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e389872-38fb-4c75-a5b8-acc23428ddd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:28.762097 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:27:28.764100 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:27:28.764754 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:27:28.765312 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:27:28.766793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:27:28.797564 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:28.798348 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:28.799178 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:28.799639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:28.828073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Getting quotas for project 3be6c3cdf062493184ab67ec3ec9940f. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:27:28.832681 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Getting quotas for user 3cf7a5b535234632bb00a9b87ceb5354 and project 3be6c3cdf062493184ab67ec3ec9940f. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:27:28.850701 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:27:28.856368 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='214a82bf-71a6-43a2-94a0-792ec7d5f308',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:27:28.996120 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3dd314d4-17bb-48d4-967e-7e3e18fe3eaf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859961 May 19 12:27:28.997148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 199/426] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:27:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:27:29.002822 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fa0ce7d7-63bd-4fbb-b148-a8e65616e3ee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:29.003555 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fa0ce7d7-63bd-4fbb-b148-a8e65616e3ee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:29.009932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fa0ce7d7-63bd-4fbb-b148-a8e65616e3ee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:29.010304 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fa0ce7d7-63bd-4fbb-b148-a8e65616e3ee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:29.012393 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fa0ce7d7-63bd-4fbb-b148-a8e65616e3ee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:29.012869 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fa0ce7d7-63bd-4fbb-b148-a8e65616e3ee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:29.165621 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-fa0ce7d7-63bd-4fbb-b148-a8e65616e3ee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:29.174765 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fa0ce7d7-63bd-4fbb-b148-a8e65616e3ee tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1371 microversion: 2.1 time: 0.176235 May 19 12:27:29.175769 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 200/427] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:28 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:29.180768 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-a4031f4b-6b8c-463a-842b-6b2d73e8b4fa req-35fb88c5-6460-4366-ae46-cab92b29e7b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7fd7551-12f3-4549-9429-3a9ecd8dd150", "name": "network-vif-plugged", "status": "completed", "tag": "849d8b72-d2dd-410e-89b0-e5a60ec6340e"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:29.200124 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-a4031f4b-6b8c-463a-842b-6b2d73e8b4fa req-35fb88c5-6460-4366-ae46-cab92b29e7b0 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:29.200124 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-a4031f4b-6b8c-463a-842b-6b2d73e8b4fa req-35fb88c5-6460-4366-ae46-cab92b29e7b0 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:29.211755 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-a4031f4b-6b8c-463a-842b-6b2d73e8b4fa req-35fb88c5-6460-4366-ae46-cab92b29e7b0 service nova] Creating event network-vif-plugged:849d8b72-d2dd-410e-89b0-e5a60ec6340e for instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 on hv-cinder-77819 May 19 12:27:29.218073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-a4031f4b-6b8c-463a-842b-6b2d73e8b4fa req-35fb88c5-6460-4366-ae46-cab92b29e7b0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041393 May 19 12:27:29.218734 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 201/428] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:29.223958 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dda0d4a6-760c-427e-9a12-785e6e050033 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:29.224684 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dda0d4a6-760c-427e-9a12-785e6e050033 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:29.280643 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dda0d4a6-760c-427e-9a12-785e6e050033 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:29.287327 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dda0d4a6-760c-427e-9a12-785e6e050033 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1257 microversion: 2.1 time: 0.067291 May 19 12:27:29.287898 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 202/429] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:29 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:29.660677 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6e389872-38fb-4c75-a5b8-acc23428ddd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "POST /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.219948 May 19 12:27:29.661577 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 228/430] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:27:28 2022] POST /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/os-volume_attachments => generated 194 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:27:30.201619 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-83bb7d5f-65fe-44b8-a5d2-5953a5f17a96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:30.203184 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-83bb7d5f-65fe-44b8-a5d2-5953a5f17a96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:30.220279 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83bb7d5f-65fe-44b8-a5d2-5953a5f17a96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:30.221672 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83bb7d5f-65fe-44b8-a5d2-5953a5f17a96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:30.223658 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83bb7d5f-65fe-44b8-a5d2-5953a5f17a96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:30.226110 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83bb7d5f-65fe-44b8-a5d2-5953a5f17a96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:30.307757 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-65845935-f029-42d0-bd59-166fe2fdb53e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:30.309577 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-65845935-f029-42d0-bd59-166fe2fdb53e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:30.311833 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:30.378301 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-65845935-f029-42d0-bd59-166fe2fdb53e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:30.393963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-65845935-f029-42d0-bd59-166fe2fdb53e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1257 microversion: 2.1 time: 0.091313 May 19 12:27:30.395155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 229/431] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:30 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1257 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:30.433721 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-83bb7d5f-65fe-44b8-a5d2-5953a5f17a96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:30.445324 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-83bb7d5f-65fe-44b8-a5d2-5953a5f17a96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1371 microversion: 2.1 time: 0.251001 May 19 12:27:30.456034 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 203/432] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:30 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1371 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:30.623814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2f818ff2-a13e-4f90-af28-11fa5d80571b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:30.624328 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2f818ff2-a13e-4f90-af28-11fa5d80571b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:30.632122 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f818ff2-a13e-4f90-af28-11fa5d80571b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:30.632455 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f818ff2-a13e-4f90-af28-11fa5d80571b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:30.633233 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f818ff2-a13e-4f90-af28-11fa5d80571b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:30.633674 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2f818ff2-a13e-4f90-af28-11fa5d80571b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:30.659867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2f818ff2-a13e-4f90-af28-11fa5d80571b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/ips" status: 200 len: 149 microversion: 2.1 time: 0.040196 May 19 12:27:30.660461 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 230/433] 10.222.0.57 () {58 vars in 1247 bytes} [Thu May 19 12:27:30 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:27:31.421695 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-21019e77-975a-4e37-9b27-38361f0e88a0 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:31.421695 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-21019e77-975a-4e37-9b27-38361f0e88a0 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:31.432834 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-21019e77-975a-4e37-9b27-38361f0e88a0 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:31.433829 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-21019e77-975a-4e37-9b27-38361f0e88a0 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:31.436115 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-21019e77-975a-4e37-9b27-38361f0e88a0 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:31.437058 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-21019e77-975a-4e37-9b27-38361f0e88a0 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:31.462782 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-438b2cfb-5c9d-4c51-a9b4-5718af57ef96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:31.468079 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-438b2cfb-5c9d-4c51-a9b4-5718af57ef96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:31.487167 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-438b2cfb-5c9d-4c51-a9b4-5718af57ef96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:31.487743 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-438b2cfb-5c9d-4c51-a9b4-5718af57ef96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:31.490030 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-438b2cfb-5c9d-4c51-a9b4-5718af57ef96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:31.491981 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-438b2cfb-5c9d-4c51-a9b4-5718af57ef96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:31.591804 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-21019e77-975a-4e37-9b27-38361f0e88a0 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:31.616290 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-21019e77-975a-4e37-9b27-38361f0e88a0 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1261 microversion: 2.1 time: 0.194469 May 19 12:27:31.616290 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 204/434] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:31 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1261 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:31.728001 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-438b2cfb-5c9d-4c51-a9b4-5718af57ef96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:31.736928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-438b2cfb-5c9d-4c51-a9b4-5718af57ef96 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1371 microversion: 2.1 time: 0.278208 May 19 12:27:31.737461 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 231/435] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:31 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:32.629455 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ceda8082-55c4-4832-8d60-7a91a77b6a82 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:32.629455 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ceda8082-55c4-4832-8d60-7a91a77b6a82 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:32.634381 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ceda8082-55c4-4832-8d60-7a91a77b6a82 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:32.635525 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ceda8082-55c4-4832-8d60-7a91a77b6a82 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:32.639130 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ceda8082-55c4-4832-8d60-7a91a77b6a82 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:32.640109 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ceda8082-55c4-4832-8d60-7a91a77b6a82 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:32.724342 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ceda8082-55c4-4832-8d60-7a91a77b6a82 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:32.733085 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ceda8082-55c4-4832-8d60-7a91a77b6a82 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1253 microversion: 2.1 time: 0.113513 May 19 12:27:32.733987 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 205/436] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:32 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1253 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:32.754730 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-bb2be6a0-40ab-4645-ac73-868dd5f316b7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:32.755654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-bb2be6a0-40ab-4645-ac73-868dd5f316b7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:32.762811 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bb2be6a0-40ab-4645-ac73-868dd5f316b7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:32.763483 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bb2be6a0-40ab-4645-ac73-868dd5f316b7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:32.764286 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bb2be6a0-40ab-4645-ac73-868dd5f316b7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:32.764718 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bb2be6a0-40ab-4645-ac73-868dd5f316b7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:32.928881 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bb2be6a0-40ab-4645-ac73-868dd5f316b7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:32.936892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-bb2be6a0-40ab-4645-ac73-868dd5f316b7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1565 microversion: 2.1 time: 0.185830 May 19 12:27:32.937483 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 232/437] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:32 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1565 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:32.957663 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dfe2658d-d434-4638-8df4-b787875a232c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:32.958303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dfe2658d-d434-4638-8df4-b787875a232c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:32.966727 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dfe2658d-d434-4638-8df4-b787875a232c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:32.967182 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dfe2658d-d434-4638-8df4-b787875a232c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:32.967998 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dfe2658d-d434-4638-8df4-b787875a232c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:32.968433 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dfe2658d-d434-4638-8df4-b787875a232c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:33.079962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dfe2658d-d434-4638-8df4-b787875a232c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126783 May 19 12:27:33.080576 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 206/438] 10.222.0.57 () {58 vars in 1274 bytes} [Thu May 19 12:27:32 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:27:33.766777 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f36747ae-fb71-4825-92cc-c7d88f2d33ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:33.767400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f36747ae-fb71-4825-92cc-c7d88f2d33ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:33.783349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f36747ae-fb71-4825-92cc-c7d88f2d33ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:33.783807 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f36747ae-fb71-4825-92cc-c7d88f2d33ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:33.784608 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f36747ae-fb71-4825-92cc-c7d88f2d33ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:33.785071 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f36747ae-fb71-4825-92cc-c7d88f2d33ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:33.812119 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-17879c3c-a7b8-4398-99ab-57942acf9aaf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0ca06d3-9df8-40b2-99d6-eefcc48fa708"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:33.813237 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-17879c3c-a7b8-4398-99ab-57942acf9aaf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:33.821142 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17879c3c-a7b8-4398-99ab-57942acf9aaf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:33.822068 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17879c3c-a7b8-4398-99ab-57942acf9aaf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:33.823082 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17879c3c-a7b8-4398-99ab-57942acf9aaf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:33.825436 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17879c3c-a7b8-4398-99ab-57942acf9aaf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:33.936299 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f36747ae-fb71-4825-92cc-c7d88f2d33ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:33.953350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f36747ae-fb71-4825-92cc-c7d88f2d33ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1317 microversion: 2.1 time: 0.191585 May 19 12:27:33.954753 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 233/439] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:33 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:34.911491 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-50235ef0-a050-4f28-b716-55832b8fb87d req-fc78f5fe-8ee7-488f-9b7c-0756c70d68fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7fd7551-12f3-4549-9429-3a9ecd8dd150", "tag": "849d8b72-d2dd-410e-89b0-e5a60ec6340e"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:34.928095 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-50235ef0-a050-4f28-b716-55832b8fb87d req-fc78f5fe-8ee7-488f-9b7c-0756c70d68fa service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:34.928826 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-50235ef0-a050-4f28-b716-55832b8fb87d req-fc78f5fe-8ee7-488f-9b7c-0756c70d68fa service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:34.941921 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-50235ef0-a050-4f28-b716-55832b8fb87d req-fc78f5fe-8ee7-488f-9b7c-0756c70d68fa service nova] Creating event network-changed:849d8b72-d2dd-410e-89b0-e5a60ec6340e for instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 on hv-cinder-77819 May 19 12:27:34.949965 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-50235ef0-a050-4f28-b716-55832b8fb87d req-fc78f5fe-8ee7-488f-9b7c-0756c70d68fa service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044473 May 19 12:27:34.950662 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 234/440] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:27:34.988665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d51f64ba-8d21-4868-ba3d-008ab7f8c092 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:34.990115 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d51f64ba-8d21-4868-ba3d-008ab7f8c092 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:35.001717 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d51f64ba-8d21-4868-ba3d-008ab7f8c092 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:35.009418 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d51f64ba-8d21-4868-ba3d-008ab7f8c092 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:35.009418 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d51f64ba-8d21-4868-ba3d-008ab7f8c092 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:35.009418 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d51f64ba-8d21-4868-ba3d-008ab7f8c092 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:35.161007 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-17879c3c-a7b8-4398-99ab-57942acf9aaf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "POST /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.353673 May 19 12:27:35.166642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 207/441] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:27:33 2022] POST /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/os-volume_attachments => generated 194 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:27:35.491897 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d51f64ba-8d21-4868-ba3d-008ab7f8c092 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:35.501733 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d51f64ba-8d21-4868-ba3d-008ab7f8c092 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.524446 May 19 12:27:35.506048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 235/442] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:34 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:36.520259 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-51428df7-06c6-4e34-b04f-c85c35dae749 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:36.521647 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-51428df7-06c6-4e34-b04f-c85c35dae749 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:36.532617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51428df7-06c6-4e34-b04f-c85c35dae749 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:36.533612 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51428df7-06c6-4e34-b04f-c85c35dae749 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:36.535071 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51428df7-06c6-4e34-b04f-c85c35dae749 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:36.536116 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51428df7-06c6-4e34-b04f-c85c35dae749 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:36.871560 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-51428df7-06c6-4e34-b04f-c85c35dae749 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:36.884880 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-51428df7-06c6-4e34-b04f-c85c35dae749 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.369320 May 19 12:27:36.885728 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 208/443] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:36 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:37.695950 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-197bf63d-6986-4a5b-9974-5d7edf415685 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:37.696498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-197bf63d-6986-4a5b-9974-5d7edf415685 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:37.703382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-197bf63d-6986-4a5b-9974-5d7edf415685 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:37.704339 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-197bf63d-6986-4a5b-9974-5d7edf415685 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:37.705143 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-197bf63d-6986-4a5b-9974-5d7edf415685 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:37.705763 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-197bf63d-6986-4a5b-9974-5d7edf415685 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:37.733781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-197bf63d-6986-4a5b-9974-5d7edf415685 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/ips" status: 200 len: 152 microversion: 2.20 time: 0.041718 May 19 12:27:37.734731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 236/444] 10.222.0.57 () {60 vars in 1288 bytes} [Thu May 19 12:27:37 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:27:37.906502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bea4cc96-11b6-4997-832f-b277a3644287 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:37.907717 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bea4cc96-11b6-4997-832f-b277a3644287 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:37.917829 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bea4cc96-11b6-4997-832f-b277a3644287 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:37.918317 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bea4cc96-11b6-4997-832f-b277a3644287 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:37.919144 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bea4cc96-11b6-4997-832f-b277a3644287 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:37.919584 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bea4cc96-11b6-4997-832f-b277a3644287 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:38.105892 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bea4cc96-11b6-4997-832f-b277a3644287 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:38.111779 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:38.121693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bea4cc96-11b6-4997-832f-b277a3644287 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.221791 May 19 12:27:38.123179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 209/445] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:37 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:39.142009 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fe36d2fc-42c6-4b96-a281-5a57a37fb3e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:39.142830 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fe36d2fc-42c6-4b96-a281-5a57a37fb3e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:39.152605 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe36d2fc-42c6-4b96-a281-5a57a37fb3e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:39.153222 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe36d2fc-42c6-4b96-a281-5a57a37fb3e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:39.154432 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe36d2fc-42c6-4b96-a281-5a57a37fb3e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:39.155381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe36d2fc-42c6-4b96-a281-5a57a37fb3e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:39.327970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fe36d2fc-42c6-4b96-a281-5a57a37fb3e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:39.336197 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fe36d2fc-42c6-4b96-a281-5a57a37fb3e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.200483 May 19 12:27:39.336786 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 237/446] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:39 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:40.356580 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f1b5965b-29b2-411c-80e6-8f1597de70b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:40.357131 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f1b5965b-29b2-411c-80e6-8f1597de70b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:40.359485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:40.361035 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=8 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:40.366921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f1b5965b-29b2-411c-80e6-8f1597de70b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:40.367374 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f1b5965b-29b2-411c-80e6-8f1597de70b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:40.368137 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f1b5965b-29b2-411c-80e6-8f1597de70b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:40.368582 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f1b5965b-29b2-411c-80e6-8f1597de70b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:40.541784 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f1b5965b-29b2-411c-80e6-8f1597de70b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:40.551847 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f1b5965b-29b2-411c-80e6-8f1597de70b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.200219 May 19 12:27:40.552770 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 210/447] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:40 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:41.238313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5121750b-78e5-4ea5-9bcb-958c28649c8a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:41.238934 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5121750b-78e5-4ea5-9bcb-958c28649c8a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:41.241307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=6 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:41.246810 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5121750b-78e5-4ea5-9bcb-958c28649c8a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:41.247264 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5121750b-78e5-4ea5-9bcb-958c28649c8a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:41.248093 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5121750b-78e5-4ea5-9bcb-958c28649c8a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:41.248535 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5121750b-78e5-4ea5-9bcb-958c28649c8a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:41.278738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-5121750b-78e5-4ea5-9bcb-958c28649c8a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lazy-loading 'flavor' on Instance uuid 1ac0842f-dd21-479d-894c-1080f1531013 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:27:41.585412 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1f2fdbac-634b-4dac-8369-4159c9dbc1e8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:41.586139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1f2fdbac-634b-4dac-8369-4159c9dbc1e8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:41.600841 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f2fdbac-634b-4dac-8369-4159c9dbc1e8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:41.601302 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f2fdbac-634b-4dac-8369-4159c9dbc1e8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:41.602095 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f2fdbac-634b-4dac-8369-4159c9dbc1e8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:41.602574 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f2fdbac-634b-4dac-8369-4159c9dbc1e8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:41.767379 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1f2fdbac-634b-4dac-8369-4159c9dbc1e8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:41.793798 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1f2fdbac-634b-4dac-8369-4159c9dbc1e8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.214792 May 19 12:27:41.794261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 211/448] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:41 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:42.121431 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5121750b-78e5-4ea5-9bcb-958c28649c8a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "POST /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/action" status: 202 len: 0 microversion: 2.20 time: 0.885885 May 19 12:27:42.122741 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 238/449] 10.222.0.57 () {62 vars in 1318 bytes} [Thu May 19 12:27:41 2022] POST /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/action => generated 0 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 12:27:42.133839 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b54b43c5-e57c-4768-a15a-dbfa0100a771 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:42.134763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b54b43c5-e57c-4768-a15a-dbfa0100a771 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:42.145649 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b54b43c5-e57c-4768-a15a-dbfa0100a771 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:42.146712 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b54b43c5-e57c-4768-a15a-dbfa0100a771 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:42.147504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b54b43c5-e57c-4768-a15a-dbfa0100a771 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:42.147941 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b54b43c5-e57c-4768-a15a-dbfa0100a771 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:42.322626 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b54b43c5-e57c-4768-a15a-dbfa0100a771 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:42.338143 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b54b43c5-e57c-4768-a15a-dbfa0100a771 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:42.341701 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b54b43c5-e57c-4768-a15a-dbfa0100a771 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:42.342989 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b54b43c5-e57c-4768-a15a-dbfa0100a771 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.215759 May 19 12:27:42.355015 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 212/450] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:42 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:27:42.813191 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e88058d8-7b08-4e31-9905-d90ee35eb800 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:42.813792 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e88058d8-7b08-4e31-9905-d90ee35eb800 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:42.822299 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e88058d8-7b08-4e31-9905-d90ee35eb800 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:42.823153 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e88058d8-7b08-4e31-9905-d90ee35eb800 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:42.824222 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e88058d8-7b08-4e31-9905-d90ee35eb800 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:42.824665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e88058d8-7b08-4e31-9905-d90ee35eb800 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:42.986396 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e88058d8-7b08-4e31-9905-d90ee35eb800 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:42.995229 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e88058d8-7b08-4e31-9905-d90ee35eb800 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.187800 May 19 12:27:42.996289 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 239/451] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:42 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:43.361676 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-83afea49-19b3-456c-910d-cfe9d72ac5be tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:43.362383 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-83afea49-19b3-456c-910d-cfe9d72ac5be tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:43.368994 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83afea49-19b3-456c-910d-cfe9d72ac5be tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:43.369443 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83afea49-19b3-456c-910d-cfe9d72ac5be tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:43.370853 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83afea49-19b3-456c-910d-cfe9d72ac5be tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:43.371354 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-83afea49-19b3-456c-910d-cfe9d72ac5be tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:43.521870 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-83afea49-19b3-456c-910d-cfe9d72ac5be tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:43.531696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-83afea49-19b3-456c-910d-cfe9d72ac5be tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:43.533199 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-83afea49-19b3-456c-910d-cfe9d72ac5be tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:43.534362 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-83afea49-19b3-456c-910d-cfe9d72ac5be tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.176598 May 19 12:27:43.534946 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 213/452] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:43 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:27:44.013133 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1bee2bb3-271b-43ea-a740-cde0717853af tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:44.013768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1bee2bb3-271b-43ea-a740-cde0717853af tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:44.020663 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1bee2bb3-271b-43ea-a740-cde0717853af tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:44.021128 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1bee2bb3-271b-43ea-a740-cde0717853af tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:44.021927 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1bee2bb3-271b-43ea-a740-cde0717853af tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:44.022332 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1bee2bb3-271b-43ea-a740-cde0717853af tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:44.184305 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1bee2bb3-271b-43ea-a740-cde0717853af tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:44.186744 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:44.193227 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1bee2bb3-271b-43ea-a740-cde0717853af tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.183831 May 19 12:27:44.193819 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 240/453] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:44 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:44.556103 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2b1a50dd-b690-4011-94ed-6361e0f33fb3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:44.556823 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2b1a50dd-b690-4011-94ed-6361e0f33fb3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:44.563884 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b1a50dd-b690-4011-94ed-6361e0f33fb3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:44.568213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b1a50dd-b690-4011-94ed-6361e0f33fb3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:44.568213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b1a50dd-b690-4011-94ed-6361e0f33fb3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:44.568213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2b1a50dd-b690-4011-94ed-6361e0f33fb3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:44.720055 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2b1a50dd-b690-4011-94ed-6361e0f33fb3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:44.729038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2b1a50dd-b690-4011-94ed-6361e0f33fb3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:44.732767 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2b1a50dd-b690-4011-94ed-6361e0f33fb3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:44.734255 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2b1a50dd-b690-4011-94ed-6361e0f33fb3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.184257 May 19 12:27:44.735403 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 214/454] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:44 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:27:45.211031 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c4079b99-46be-435f-88da-68231e2bc8c9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:45.211656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c4079b99-46be-435f-88da-68231e2bc8c9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:45.219878 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c4079b99-46be-435f-88da-68231e2bc8c9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:45.220605 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c4079b99-46be-435f-88da-68231e2bc8c9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:45.221373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c4079b99-46be-435f-88da-68231e2bc8c9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:45.221801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c4079b99-46be-435f-88da-68231e2bc8c9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:45.392735 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c4079b99-46be-435f-88da-68231e2bc8c9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:45.400463 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c4079b99-46be-435f-88da-68231e2bc8c9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.193468 May 19 12:27:45.404953 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 241/455] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:45 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:45.753620 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3b0101ea-f787-4239-b1c0-f47e12cbe7a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:45.754578 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3b0101ea-f787-4239-b1c0-f47e12cbe7a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:45.763644 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3b0101ea-f787-4239-b1c0-f47e12cbe7a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:45.769580 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3b0101ea-f787-4239-b1c0-f47e12cbe7a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:45.769580 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3b0101ea-f787-4239-b1c0-f47e12cbe7a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:45.769580 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3b0101ea-f787-4239-b1c0-f47e12cbe7a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:45.924476 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3b0101ea-f787-4239-b1c0-f47e12cbe7a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:45.933275 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3b0101ea-f787-4239-b1c0-f47e12cbe7a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:45.934833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3b0101ea-f787-4239-b1c0-f47e12cbe7a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:45.936028 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3b0101ea-f787-4239-b1c0-f47e12cbe7a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.186815 May 19 12:27:45.936912 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 215/456] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:45 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:27:46.417133 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f27dd332-eb17-40a9-897c-24fd0a1eddf1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:46.417932 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f27dd332-eb17-40a9-897c-24fd0a1eddf1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:46.424940 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f27dd332-eb17-40a9-897c-24fd0a1eddf1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:46.425475 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f27dd332-eb17-40a9-897c-24fd0a1eddf1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:46.426375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f27dd332-eb17-40a9-897c-24fd0a1eddf1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:46.427122 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f27dd332-eb17-40a9-897c-24fd0a1eddf1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:46.574945 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f27dd332-eb17-40a9-897c-24fd0a1eddf1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:46.583846 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f27dd332-eb17-40a9-897c-24fd0a1eddf1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.170482 May 19 12:27:46.584604 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 242/457] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:46 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:46.956441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2737e518-fdbc-49e5-b213-eab2ec9aa874 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:46.957060 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2737e518-fdbc-49e5-b213-eab2ec9aa874 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:46.964478 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2737e518-fdbc-49e5-b213-eab2ec9aa874 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:46.965223 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2737e518-fdbc-49e5-b213-eab2ec9aa874 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:46.966193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2737e518-fdbc-49e5-b213-eab2ec9aa874 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:46.966987 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2737e518-fdbc-49e5-b213-eab2ec9aa874 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:47.138001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2737e518-fdbc-49e5-b213-eab2ec9aa874 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:47.149714 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2737e518-fdbc-49e5-b213-eab2ec9aa874 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:47.152655 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2737e518-fdbc-49e5-b213-eab2ec9aa874 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:47.154378 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2737e518-fdbc-49e5-b213-eab2ec9aa874 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.201736 May 19 12:27:47.155589 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 216/458] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:46 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:27:47.600814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-05c2d938-47a8-44a9-b6ba-5398528bb39e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:47.601563 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-05c2d938-47a8-44a9-b6ba-5398528bb39e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:47.608510 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-05c2d938-47a8-44a9-b6ba-5398528bb39e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:47.608966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-05c2d938-47a8-44a9-b6ba-5398528bb39e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:47.609744 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-05c2d938-47a8-44a9-b6ba-5398528bb39e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:47.610188 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-05c2d938-47a8-44a9-b6ba-5398528bb39e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:47.752059 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-05c2d938-47a8-44a9-b6ba-5398528bb39e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:47.759646 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-05c2d938-47a8-44a9-b6ba-5398528bb39e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.162636 May 19 12:27:47.760150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 243/459] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:47 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:48.173449 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9c937cea-2389-4982-bb58-68ab6e22b930 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:48.174054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9c937cea-2389-4982-bb58-68ab6e22b930 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:48.190084 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9c937cea-2389-4982-bb58-68ab6e22b930 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:48.190937 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9c937cea-2389-4982-bb58-68ab6e22b930 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:48.192214 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9c937cea-2389-4982-bb58-68ab6e22b930 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:48.192909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9c937cea-2389-4982-bb58-68ab6e22b930 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:48.346489 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9c937cea-2389-4982-bb58-68ab6e22b930 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:48.357314 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9c937cea-2389-4982-bb58-68ab6e22b930 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:48.358989 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9c937cea-2389-4982-bb58-68ab6e22b930 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:48.360689 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9c937cea-2389-4982-bb58-68ab6e22b930 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.190953 May 19 12:27:48.361695 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 217/460] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:48 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:27:48.777720 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-72166607-b535-477d-abb9-f0e0b4351cd5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:48.782395 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-72166607-b535-477d-abb9-f0e0b4351cd5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:48.785060 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-72166607-b535-477d-abb9-f0e0b4351cd5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:48.785511 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-72166607-b535-477d-abb9-f0e0b4351cd5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:48.786287 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-72166607-b535-477d-abb9-f0e0b4351cd5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:48.786759 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-72166607-b535-477d-abb9-f0e0b4351cd5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:48.936285 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-72166607-b535-477d-abb9-f0e0b4351cd5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:48.943966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-72166607-b535-477d-abb9-f0e0b4351cd5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.170235 May 19 12:27:48.944547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 244/461] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:48 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:49.379087 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ba3f853b-6ee2-4656-a9a4-96877931a266 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:49.379606 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ba3f853b-6ee2-4656-a9a4-96877931a266 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:49.386783 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba3f853b-6ee2-4656-a9a4-96877931a266 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:49.387230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba3f853b-6ee2-4656-a9a4-96877931a266 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:49.388003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba3f853b-6ee2-4656-a9a4-96877931a266 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:49.388437 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba3f853b-6ee2-4656-a9a4-96877931a266 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:49.523914 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ba3f853b-6ee2-4656-a9a4-96877931a266 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:49.533236 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ba3f853b-6ee2-4656-a9a4-96877931a266 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:49.534785 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ba3f853b-6ee2-4656-a9a4-96877931a266 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:49.535966 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ba3f853b-6ee2-4656-a9a4-96877931a266 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.160858 May 19 12:27:49.536541 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 218/462] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:49 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:27:49.961500 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-55e1b1fd-61e2-4757-ad65-722a885d23ad tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:49.962157 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-55e1b1fd-61e2-4757-ad65-722a885d23ad tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:49.969456 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55e1b1fd-61e2-4757-ad65-722a885d23ad tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:49.969903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55e1b1fd-61e2-4757-ad65-722a885d23ad tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:49.970692 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55e1b1fd-61e2-4757-ad65-722a885d23ad tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:49.971122 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55e1b1fd-61e2-4757-ad65-722a885d23ad tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:50.099312 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-55e1b1fd-61e2-4757-ad65-722a885d23ad tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:50.106521 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-55e1b1fd-61e2-4757-ad65-722a885d23ad tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.148730 May 19 12:27:50.107090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 245/463] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:49 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:50.555137 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c4a5b01d-b7cb-4b31-9118-e6b2b51cc887 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:50.555785 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c4a5b01d-b7cb-4b31-9118-e6b2b51cc887 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:50.558291 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:50.564037 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4a5b01d-b7cb-4b31-9118-e6b2b51cc887 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:50.564417 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4a5b01d-b7cb-4b31-9118-e6b2b51cc887 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:50.565228 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4a5b01d-b7cb-4b31-9118-e6b2b51cc887 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:50.565660 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4a5b01d-b7cb-4b31-9118-e6b2b51cc887 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:50.713441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c4a5b01d-b7cb-4b31-9118-e6b2b51cc887 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:50.722727 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c4a5b01d-b7cb-4b31-9118-e6b2b51cc887 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:50.724316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c4a5b01d-b7cb-4b31-9118-e6b2b51cc887 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:50.725749 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c4a5b01d-b7cb-4b31-9118-e6b2b51cc887 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.174613 May 19 12:27:50.726579 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 219/464] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:50 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:27:51.124148 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-33eec1f5-0395-4b86-9dc9-5a518d628237 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:51.124755 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-33eec1f5-0395-4b86-9dc9-5a518d628237 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:51.131717 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-33eec1f5-0395-4b86-9dc9-5a518d628237 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:51.132285 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-33eec1f5-0395-4b86-9dc9-5a518d628237 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:51.132960 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-33eec1f5-0395-4b86-9dc9-5a518d628237 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:51.133426 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-33eec1f5-0395-4b86-9dc9-5a518d628237 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:51.273784 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-33eec1f5-0395-4b86-9dc9-5a518d628237 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:51.281623 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-33eec1f5-0395-4b86-9dc9-5a518d628237 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.162150 May 19 12:27:51.282231 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 246/465] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:51 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:51.745353 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9f6b724c-30f4-460c-8a60-bc131e75b954 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:51.745995 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9f6b724c-30f4-460c-8a60-bc131e75b954 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:51.753852 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9f6b724c-30f4-460c-8a60-bc131e75b954 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:51.754216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9f6b724c-30f4-460c-8a60-bc131e75b954 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:51.755091 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9f6b724c-30f4-460c-8a60-bc131e75b954 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:51.755534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9f6b724c-30f4-460c-8a60-bc131e75b954 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:51.913426 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9f6b724c-30f4-460c-8a60-bc131e75b954 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:51.919492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9f6b724c-30f4-460c-8a60-bc131e75b954 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:51.921021 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9f6b724c-30f4-460c-8a60-bc131e75b954 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:51.922757 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9f6b724c-30f4-460c-8a60-bc131e75b954 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.181492 May 19 12:27:51.923331 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 220/466] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:51 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:27:52.298863 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-85e621b5-9080-4aa0-8d13-78dc0a83ecee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:52.299408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-85e621b5-9080-4aa0-8d13-78dc0a83ecee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:52.306563 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-85e621b5-9080-4aa0-8d13-78dc0a83ecee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:52.307120 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-85e621b5-9080-4aa0-8d13-78dc0a83ecee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:52.307956 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-85e621b5-9080-4aa0-8d13-78dc0a83ecee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:52.308392 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-85e621b5-9080-4aa0-8d13-78dc0a83ecee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:52.448354 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-85e621b5-9080-4aa0-8d13-78dc0a83ecee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:52.458501 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-85e621b5-9080-4aa0-8d13-78dc0a83ecee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.163551 May 19 12:27:52.459464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 247/467] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:52 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:27:52.944642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a4186045-065a-4bf9-aae1-5f299c0a53d4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:52.945346 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a4186045-065a-4bf9-aae1-5f299c0a53d4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:52.965954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a4186045-065a-4bf9-aae1-5f299c0a53d4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:52.965954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a4186045-065a-4bf9-aae1-5f299c0a53d4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:52.965954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a4186045-065a-4bf9-aae1-5f299c0a53d4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:52.965954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a4186045-065a-4bf9-aae1-5f299c0a53d4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:53.135636 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a4186045-065a-4bf9-aae1-5f299c0a53d4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:53.155967 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a4186045-065a-4bf9-aae1-5f299c0a53d4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:53.155967 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a4186045-065a-4bf9-aae1-5f299c0a53d4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:53.155967 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a4186045-065a-4bf9-aae1-5f299c0a53d4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.213341 May 19 12:27:53.156361 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 221/468] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:52 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:27:53.477141 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3cfa702f-6de7-466c-9ac8-6d1a27aee643 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:53.477758 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3cfa702f-6de7-466c-9ac8-6d1a27aee643 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:53.490755 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cfa702f-6de7-466c-9ac8-6d1a27aee643 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:53.490755 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cfa702f-6de7-466c-9ac8-6d1a27aee643 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:53.490755 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cfa702f-6de7-466c-9ac8-6d1a27aee643 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:53.490755 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cfa702f-6de7-466c-9ac8-6d1a27aee643 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:53.631092 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3cfa702f-6de7-466c-9ac8-6d1a27aee643 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:53.641191 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3cfa702f-6de7-466c-9ac8-6d1a27aee643 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.167724 May 19 12:27:53.642027 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 248/469] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:53 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:54.180039 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-81b39bcd-d4a6-4add-b273-d036bf1a500d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:54.180722 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-81b39bcd-d4a6-4add-b273-d036bf1a500d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:54.187977 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81b39bcd-d4a6-4add-b273-d036bf1a500d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:54.188428 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81b39bcd-d4a6-4add-b273-d036bf1a500d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:54.189216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81b39bcd-d4a6-4add-b273-d036bf1a500d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:54.189646 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-81b39bcd-d4a6-4add-b273-d036bf1a500d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:54.350401 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-81b39bcd-d4a6-4add-b273-d036bf1a500d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:54.359670 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-81b39bcd-d4a6-4add-b273-d036bf1a500d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:54.361484 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-81b39bcd-d4a6-4add-b273-d036bf1a500d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:54.362741 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-81b39bcd-d4a6-4add-b273-d036bf1a500d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.191224 May 19 12:27:54.363315 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 222/470] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:54 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:27:54.659800 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ca850832-09c3-4fce-8f50-f797e5c6f497 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:54.660427 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ca850832-09c3-4fce-8f50-f797e5c6f497 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:54.668161 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca850832-09c3-4fce-8f50-f797e5c6f497 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:54.668628 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca850832-09c3-4fce-8f50-f797e5c6f497 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:54.669475 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca850832-09c3-4fce-8f50-f797e5c6f497 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:54.669968 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca850832-09c3-4fce-8f50-f797e5c6f497 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:54.844332 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ca850832-09c3-4fce-8f50-f797e5c6f497 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:54.852312 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ca850832-09c3-4fce-8f50-f797e5c6f497 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.196711 May 19 12:27:54.852901 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 249/471] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:54 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:55.392422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-36090908-f200-4b84-8ef4-7bdd7efc27cf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:55.393780 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-36090908-f200-4b84-8ef4-7bdd7efc27cf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:55.401361 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-36090908-f200-4b84-8ef4-7bdd7efc27cf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:55.401964 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-36090908-f200-4b84-8ef4-7bdd7efc27cf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:55.402794 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-36090908-f200-4b84-8ef4-7bdd7efc27cf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:55.403416 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-36090908-f200-4b84-8ef4-7bdd7efc27cf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:55.557438 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-36090908-f200-4b84-8ef4-7bdd7efc27cf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:55.566709 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-36090908-f200-4b84-8ef4-7bdd7efc27cf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:55.568207 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-36090908-f200-4b84-8ef4-7bdd7efc27cf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:55.569391 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-36090908-f200-4b84-8ef4-7bdd7efc27cf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.181528 May 19 12:27:55.575319 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 223/472] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:55 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:27:55.871789 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ce72b3ff-7856-4349-99e0-1610fbc06b2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:55.872429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ce72b3ff-7856-4349-99e0-1610fbc06b2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:55.879352 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ce72b3ff-7856-4349-99e0-1610fbc06b2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:55.879802 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ce72b3ff-7856-4349-99e0-1610fbc06b2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:55.880620 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ce72b3ff-7856-4349-99e0-1610fbc06b2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:55.881074 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ce72b3ff-7856-4349-99e0-1610fbc06b2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:56.050221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ce72b3ff-7856-4349-99e0-1610fbc06b2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:56.059546 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ce72b3ff-7856-4349-99e0-1610fbc06b2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.192202 May 19 12:27:56.060341 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 250/473] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:55 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:56.587855 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bf681277-610c-4279-824f-a85fb5137cd1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:56.588564 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bf681277-610c-4279-824f-a85fb5137cd1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:56.596497 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bf681277-610c-4279-824f-a85fb5137cd1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:56.596966 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bf681277-610c-4279-824f-a85fb5137cd1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:56.597727 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bf681277-610c-4279-824f-a85fb5137cd1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:56.598218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bf681277-610c-4279-824f-a85fb5137cd1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:56.730469 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bf681277-610c-4279-824f-a85fb5137cd1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:56.738732 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bf681277-610c-4279-824f-a85fb5137cd1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:56.740233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bf681277-610c-4279-824f-a85fb5137cd1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:56.741389 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bf681277-610c-4279-824f-a85fb5137cd1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.157615 May 19 12:27:56.742009 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 224/474] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:56 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:27:57.083941 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d5a5a554-0f43-426d-a4ee-4318f4ac7157 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:57.084579 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d5a5a554-0f43-426d-a4ee-4318f4ac7157 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:57.091348 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5a5a554-0f43-426d-a4ee-4318f4ac7157 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:57.091802 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5a5a554-0f43-426d-a4ee-4318f4ac7157 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:57.092587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5a5a554-0f43-426d-a4ee-4318f4ac7157 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:57.093018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5a5a554-0f43-426d-a4ee-4318f4ac7157 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:57.242916 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d5a5a554-0f43-426d-a4ee-4318f4ac7157 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:57.250599 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d5a5a554-0f43-426d-a4ee-4318f4ac7157 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.170690 May 19 12:27:57.251166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 251/475] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:57 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:57.762202 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-49b7589c-c3eb-44c6-adfe-f81471da990c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:57.763044 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-49b7589c-c3eb-44c6-adfe-f81471da990c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:57.779273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-49b7589c-c3eb-44c6-adfe-f81471da990c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:57.779808 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-49b7589c-c3eb-44c6-adfe-f81471da990c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:57.780708 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-49b7589c-c3eb-44c6-adfe-f81471da990c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:57.781239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-49b7589c-c3eb-44c6-adfe-f81471da990c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:57.988936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-49b7589c-c3eb-44c6-adfe-f81471da990c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:57.999179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-49b7589c-c3eb-44c6-adfe-f81471da990c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:58.000940 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-49b7589c-c3eb-44c6-adfe-f81471da990c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:58.002398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-49b7589c-c3eb-44c6-adfe-f81471da990c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.245362 May 19 12:27:58.003093 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 225/476] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:57 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:27:58.268407 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8e6f70d1-7259-4728-80ac-e22027b75be9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:58.269159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8e6f70d1-7259-4728-80ac-e22027b75be9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:58.282633 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8e6f70d1-7259-4728-80ac-e22027b75be9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:58.282633 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8e6f70d1-7259-4728-80ac-e22027b75be9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:58.282633 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8e6f70d1-7259-4728-80ac-e22027b75be9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:58.282633 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8e6f70d1-7259-4728-80ac-e22027b75be9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:58.446259 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8e6f70d1-7259-4728-80ac-e22027b75be9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:58.456949 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8e6f70d1-7259-4728-80ac-e22027b75be9 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.192395 May 19 12:27:58.457575 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 252/477] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:58 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:59.032020 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cf5cb2e4-e83e-4c24-a608-82209783e953 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:59.032965 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cf5cb2e4-e83e-4c24-a608-82209783e953 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:59.041236 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cf5cb2e4-e83e-4c24-a608-82209783e953 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:59.041690 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cf5cb2e4-e83e-4c24-a608-82209783e953 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:59.042772 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cf5cb2e4-e83e-4c24-a608-82209783e953 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:59.043222 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cf5cb2e4-e83e-4c24-a608-82209783e953 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:59.063160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:27:59.192692 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cf5cb2e4-e83e-4c24-a608-82209783e953 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:59.202665 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cf5cb2e4-e83e-4c24-a608-82209783e953 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:59.212099 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cf5cb2e4-e83e-4c24-a608-82209783e953 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:59.212099 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cf5cb2e4-e83e-4c24-a608-82209783e953 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.180982 May 19 12:27:59.212099 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 226/478] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:27:59 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:27:59.474659 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-507375da-9863-480b-90db-6f946cfb8478 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:27:59.475253 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-507375da-9863-480b-90db-6f946cfb8478 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:27:59.482499 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-507375da-9863-480b-90db-6f946cfb8478 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:59.482965 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-507375da-9863-480b-90db-6f946cfb8478 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:59.483758 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-507375da-9863-480b-90db-6f946cfb8478 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:59.484193 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-507375da-9863-480b-90db-6f946cfb8478 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:59.665150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-507375da-9863-480b-90db-6f946cfb8478 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:27:59.686170 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-507375da-9863-480b-90db-6f946cfb8478 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.215282 May 19 12:27:59.687894 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 253/479] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:27:59 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:27:59.880390 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-4b982dc7-be74-4699-8f8d-7efd3260ca24 req-9124dddb-0965-499b-aeb7-087dc60e8d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70659f4e-c927-47dc-a23a-abd0db258731", "tag": "d7221580-bd77-42eb-a222-b1dd8a491c4c"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:27:59.891009 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4b982dc7-be74-4699-8f8d-7efd3260ca24 req-9124dddb-0965-499b-aeb7-087dc60e8d05 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:27:59.892220 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4b982dc7-be74-4699-8f8d-7efd3260ca24 req-9124dddb-0965-499b-aeb7-087dc60e8d05 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:27:59.907497 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-4b982dc7-be74-4699-8f8d-7efd3260ca24 req-9124dddb-0965-499b-aeb7-087dc60e8d05 service nova] Creating event network-changed:d7221580-bd77-42eb-a222-b1dd8a491c4c for instance 70659f4e-c927-47dc-a23a-abd0db258731 on hv-cinder-77819 May 19 12:27:59.920397 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-4b982dc7-be74-4699-8f8d-7efd3260ca24 req-9124dddb-0965-499b-aeb7-087dc60e8d05 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044075 May 19 12:27:59.921009 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 227/480] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:00.228775 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-95189daf-7bae-4870-9c20-465841d4dc1c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:00.229659 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-95189daf-7bae-4870-9c20-465841d4dc1c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:00.237924 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-95189daf-7bae-4870-9c20-465841d4dc1c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:00.238688 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-95189daf-7bae-4870-9c20-465841d4dc1c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:00.239472 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-95189daf-7bae-4870-9c20-465841d4dc1c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:00.239901 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-95189daf-7bae-4870-9c20-465841d4dc1c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:00.374704 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-95189daf-7bae-4870-9c20-465841d4dc1c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:00.382662 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-95189daf-7bae-4870-9c20-465841d4dc1c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:00.384166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-95189daf-7bae-4870-9c20-465841d4dc1c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:00.385356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-95189daf-7bae-4870-9c20-465841d4dc1c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.161155 May 19 12:28:00.385920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 254/481] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:00 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:00.704077 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-45073afb-f3ab-4f63-a1cc-906dbccba741 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:00.704813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-45073afb-f3ab-4f63-a1cc-906dbccba741 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:00.711434 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-45073afb-f3ab-4f63-a1cc-906dbccba741 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:00.711877 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-45073afb-f3ab-4f63-a1cc-906dbccba741 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:00.712655 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-45073afb-f3ab-4f63-a1cc-906dbccba741 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:00.713093 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-45073afb-f3ab-4f63-a1cc-906dbccba741 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:00.855956 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-45073afb-f3ab-4f63-a1cc-906dbccba741 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:00.864508 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-45073afb-f3ab-4f63-a1cc-906dbccba741 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.165739 May 19 12:28:00.865076 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 228/482] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:00 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:01.403793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c929149c-592a-456d-a062-19d6adc74198 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:01.404403 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c929149c-592a-456d-a062-19d6adc74198 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:01.414671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c929149c-592a-456d-a062-19d6adc74198 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:01.414671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c929149c-592a-456d-a062-19d6adc74198 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:01.414671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c929149c-592a-456d-a062-19d6adc74198 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:01.414671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c929149c-592a-456d-a062-19d6adc74198 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:01.549435 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c929149c-592a-456d-a062-19d6adc74198 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:01.557960 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c929149c-592a-456d-a062-19d6adc74198 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:01.560307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c929149c-592a-456d-a062-19d6adc74198 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:01.561468 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c929149c-592a-456d-a062-19d6adc74198 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.162097 May 19 12:28:01.562038 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 255/483] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:01 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:01.882745 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bf336d46-4a00-4294-9f57-0975b84ac6d4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:01.883361 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bf336d46-4a00-4294-9f57-0975b84ac6d4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:01.890533 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bf336d46-4a00-4294-9f57-0975b84ac6d4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:01.890983 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bf336d46-4a00-4294-9f57-0975b84ac6d4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:01.891766 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bf336d46-4a00-4294-9f57-0975b84ac6d4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:01.892208 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bf336d46-4a00-4294-9f57-0975b84ac6d4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:02.043618 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bf336d46-4a00-4294-9f57-0975b84ac6d4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:02.049835 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bf336d46-4a00-4294-9f57-0975b84ac6d4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.171057 May 19 12:28:02.050424 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 229/484] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:01 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:02.585601 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-bc15a038-f5fc-45fe-b964-243666c08b30 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:02.586699 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-bc15a038-f5fc-45fe-b964-243666c08b30 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:02.591029 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=56 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:02.600410 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bc15a038-f5fc-45fe-b964-243666c08b30 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:02.601242 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bc15a038-f5fc-45fe-b964-243666c08b30 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:02.605497 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bc15a038-f5fc-45fe-b964-243666c08b30 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:02.605497 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bc15a038-f5fc-45fe-b964-243666c08b30 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:02.759665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bc15a038-f5fc-45fe-b964-243666c08b30 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:02.769804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bc15a038-f5fc-45fe-b964-243666c08b30 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:02.771339 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bc15a038-f5fc-45fe-b964-243666c08b30 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:02.772519 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-bc15a038-f5fc-45fe-b964-243666c08b30 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.194808 May 19 12:28:02.773046 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 256/485] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:02 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:03.067941 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a78da214-422f-45a7-8333-75e446055d5c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:03.068575 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a78da214-422f-45a7-8333-75e446055d5c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:03.075908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a78da214-422f-45a7-8333-75e446055d5c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:03.076352 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a78da214-422f-45a7-8333-75e446055d5c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:03.077117 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a78da214-422f-45a7-8333-75e446055d5c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:03.077559 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a78da214-422f-45a7-8333-75e446055d5c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:03.229590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a78da214-422f-45a7-8333-75e446055d5c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:03.238704 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a78da214-422f-45a7-8333-75e446055d5c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.174494 May 19 12:28:03.239291 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 230/486] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:03 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:03.792086 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f24bd438-44ac-4dc9-b674-50effc88ceaf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:03.792738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f24bd438-44ac-4dc9-b674-50effc88ceaf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:03.802242 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f24bd438-44ac-4dc9-b674-50effc88ceaf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:03.802841 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f24bd438-44ac-4dc9-b674-50effc88ceaf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:03.803625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f24bd438-44ac-4dc9-b674-50effc88ceaf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:03.804681 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f24bd438-44ac-4dc9-b674-50effc88ceaf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:03.823383 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:03.992417 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f24bd438-44ac-4dc9-b674-50effc88ceaf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:04.008026 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f24bd438-44ac-4dc9-b674-50effc88ceaf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:04.013409 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f24bd438-44ac-4dc9-b674-50effc88ceaf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:04.015422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-123951025", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:04.015699 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f24bd438-44ac-4dc9-b674-50effc88ceaf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.227544 May 19 12:28:04.016698 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 257/487] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:03 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:04.071404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] validate_networks() for None {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:28:04.257324 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-96bc03db-f4b2-464f-b3eb-4a6771da5e9b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:04.258953 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-96bc03db-f4b2-464f-b3eb-4a6771da5e9b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:04.266800 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-96bc03db-f4b2-464f-b3eb-4a6771da5e9b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:04.269206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-96bc03db-f4b2-464f-b3eb-4a6771da5e9b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:04.270210 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-96bc03db-f4b2-464f-b3eb-4a6771da5e9b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:04.270676 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-96bc03db-f4b2-464f-b3eb-4a6771da5e9b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:04.633328 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-96bc03db-f4b2-464f-b3eb-4a6771da5e9b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:04.641660 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-96bc03db-f4b2-464f-b3eb-4a6771da5e9b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.389088 May 19 12:28:04.642565 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 258/488] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:04 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:04.682388 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:28:04.683056 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:28:04.683579 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:28:04.683820 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:28:04.684258 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:28:04.693881 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:04.694447 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:04.695356 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:04.695798 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:04.715098 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Getting quotas for project 566bbc906fb54ffab4964acccd8e68d8. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:28:04.722423 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Getting quotas for user cc67af013a0c4299acd7f2b4de73f7fa and project 566bbc906fb54ffab4964acccd8e68d8. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:28:04.733736 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:28:04.735495 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:28:04.915972 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c325b33b-543b-4fdf-ac12-bc8d0464adc6 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905457 May 19 12:28:04.925873 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 231/489] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:28:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 12:28:04.936540 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3e52a8f3-a675-4938-a32d-a2a2346ff52f tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:04.937380 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3e52a8f3-a675-4938-a32d-a2a2346ff52f tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:05.037673 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3e52a8f3-a675-4938-a32d-a2a2346ff52f tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:05.044450 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9032b3c7-7136-4550-a9e2-89133a1a723d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:05.045278 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9032b3c7-7136-4550-a9e2-89133a1a723d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:05.048392 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3e52a8f3-a675-4938-a32d-a2a2346ff52f tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1214 microversion: 2.1 time: 0.120111 May 19 12:28:05.060141 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 259/490] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:04 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:05.061456 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9032b3c7-7136-4550-a9e2-89133a1a723d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:05.062066 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9032b3c7-7136-4550-a9e2-89133a1a723d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:05.063478 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9032b3c7-7136-4550-a9e2-89133a1a723d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:05.064181 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9032b3c7-7136-4550-a9e2-89133a1a723d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:05.288978 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9032b3c7-7136-4550-a9e2-89133a1a723d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:05.299385 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9032b3c7-7136-4550-a9e2-89133a1a723d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:05.300957 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9032b3c7-7136-4550-a9e2-89133a1a723d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:05.303094 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9032b3c7-7136-4550-a9e2-89133a1a723d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.263259 May 19 12:28:05.303699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 232/491] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:05 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:05.655526 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-00dcea2b-9c58-48c9-add3-974780b3f834 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:05.661775 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-00dcea2b-9c58-48c9-add3-974780b3f834 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:05.662228 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-00dcea2b-9c58-48c9-add3-974780b3f834 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:05.664316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b9db5d19-6944-4309-b2f6-e7f80758d6b2 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:05.665024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b9db5d19-6944-4309-b2f6-e7f80758d6b2 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:05.672267 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b9db5d19-6944-4309-b2f6-e7f80758d6b2 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:05.672719 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b9db5d19-6944-4309-b2f6-e7f80758d6b2 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:05.673501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b9db5d19-6944-4309-b2f6-e7f80758d6b2 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:05.673940 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b9db5d19-6944-4309-b2f6-e7f80758d6b2 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:05.730602 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-00dcea2b-9c58-48c9-add3-974780b3f834 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Going to try to stop instance {{(pid=118112) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 12:28:05.837537 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b9db5d19-6944-4309-b2f6-e7f80758d6b2 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:05.852795 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b9db5d19-6944-4309-b2f6-e7f80758d6b2 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.192529 May 19 12:28:05.853397 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 233/492] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:05 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:06.067827 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f9baeb1d-04bf-40a3-8f24-1b74cdc6ba47 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:06.068503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f9baeb1d-04bf-40a3-8f24-1b74cdc6ba47 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:06.087347 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-00dcea2b-9c58-48c9-add3-974780b3f834 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "POST /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/action" status: 202 len: 0 microversion: 2.1 time: 0.436218 May 19 12:28:06.088108 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 260/493] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:28:05 2022] POST /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:28:06.107557 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e87e362d-7035-40c1-8afe-0017f7aa4533 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:06.108252 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e87e362d-7035-40c1-8afe-0017f7aa4533 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:06.121431 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e87e362d-7035-40c1-8afe-0017f7aa4533 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:06.122270 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e87e362d-7035-40c1-8afe-0017f7aa4533 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:06.123656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e87e362d-7035-40c1-8afe-0017f7aa4533 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:06.124388 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e87e362d-7035-40c1-8afe-0017f7aa4533 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:06.130774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f9baeb1d-04bf-40a3-8f24-1b74cdc6ba47 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:06.141925 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f9baeb1d-04bf-40a3-8f24-1b74cdc6ba47 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1214 microversion: 2.1 time: 0.077781 May 19 12:28:06.155184 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 234/494] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:06 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:06.267048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e87e362d-7035-40c1-8afe-0017f7aa4533 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:06.275837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e87e362d-7035-40c1-8afe-0017f7aa4533 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.183054 May 19 12:28:06.276409 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 261/495] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:06 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:06.322494 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f4181aa1-54ca-4428-9532-410bab86623e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:06.323118 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f4181aa1-54ca-4428-9532-410bab86623e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:06.331283 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f4181aa1-54ca-4428-9532-410bab86623e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:06.331737 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f4181aa1-54ca-4428-9532-410bab86623e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:06.332526 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f4181aa1-54ca-4428-9532-410bab86623e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:06.332982 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f4181aa1-54ca-4428-9532-410bab86623e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:06.466817 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f4181aa1-54ca-4428-9532-410bab86623e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:06.484031 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f4181aa1-54ca-4428-9532-410bab86623e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:06.485605 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f4181aa1-54ca-4428-9532-410bab86623e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:06.486809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f4181aa1-54ca-4428-9532-410bab86623e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.168231 May 19 12:28:06.487369 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 235/496] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:06 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:06.874727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f985d97a-6ce9-4a8d-af5d-3b1bbf4382c6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:06.875676 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f985d97a-6ce9-4a8d-af5d-3b1bbf4382c6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:06.885732 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f985d97a-6ce9-4a8d-af5d-3b1bbf4382c6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:06.886578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f985d97a-6ce9-4a8d-af5d-3b1bbf4382c6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:06.887557 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f985d97a-6ce9-4a8d-af5d-3b1bbf4382c6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:06.888276 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f985d97a-6ce9-4a8d-af5d-3b1bbf4382c6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:07.041057 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f985d97a-6ce9-4a8d-af5d-3b1bbf4382c6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:07.049814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f985d97a-6ce9-4a8d-af5d-3b1bbf4382c6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.183212 May 19 12:28:07.050496 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 262/497] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:06 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:07.165312 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4d03e9ff-7bd3-4b10-bd25-7b3b95d46bf0 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:07.166053 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4d03e9ff-7bd3-4b10-bd25-7b3b95d46bf0 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:07.173671 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d03e9ff-7bd3-4b10-bd25-7b3b95d46bf0 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:07.174124 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d03e9ff-7bd3-4b10-bd25-7b3b95d46bf0 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:07.174928 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d03e9ff-7bd3-4b10-bd25-7b3b95d46bf0 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:07.175363 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d03e9ff-7bd3-4b10-bd25-7b3b95d46bf0 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:07.239568 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4d03e9ff-7bd3-4b10-bd25-7b3b95d46bf0 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:07.247080 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4d03e9ff-7bd3-4b10-bd25-7b3b95d46bf0 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1218 microversion: 2.1 time: 0.086375 May 19 12:28:07.251046 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 236/498] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:07 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:07.294507 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-db261f87-17ad-4ffa-8bab-20663318ea4d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:07.295749 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-db261f87-17ad-4ffa-8bab-20663318ea4d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:07.302391 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-db261f87-17ad-4ffa-8bab-20663318ea4d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:07.305807 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-db261f87-17ad-4ffa-8bab-20663318ea4d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:07.305807 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-db261f87-17ad-4ffa-8bab-20663318ea4d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:07.305807 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-db261f87-17ad-4ffa-8bab-20663318ea4d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:07.464700 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-db261f87-17ad-4ffa-8bab-20663318ea4d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:07.474299 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-db261f87-17ad-4ffa-8bab-20663318ea4d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.183641 May 19 12:28:07.475164 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 263/499] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:07 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:07.506559 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c6645eee-5565-4d04-9537-882e38897055 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:07.507319 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c6645eee-5565-4d04-9537-882e38897055 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:07.513767 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c6645eee-5565-4d04-9537-882e38897055 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:07.514214 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c6645eee-5565-4d04-9537-882e38897055 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:07.515005 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c6645eee-5565-4d04-9537-882e38897055 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:07.515448 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c6645eee-5565-4d04-9537-882e38897055 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:07.680948 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c6645eee-5565-4d04-9537-882e38897055 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:07.690566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c6645eee-5565-4d04-9537-882e38897055 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:07.692073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c6645eee-5565-4d04-9537-882e38897055 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:07.693317 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c6645eee-5565-4d04-9537-882e38897055 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.190711 May 19 12:28:07.694317 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 237/500] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:07 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:08.068352 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-329f8926-c0e6-4a55-8f9e-55b57522761d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:08.068880 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-329f8926-c0e6-4a55-8f9e-55b57522761d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:08.076345 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-329f8926-c0e6-4a55-8f9e-55b57522761d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:08.076790 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-329f8926-c0e6-4a55-8f9e-55b57522761d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:08.077568 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-329f8926-c0e6-4a55-8f9e-55b57522761d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:08.078012 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-329f8926-c0e6-4a55-8f9e-55b57522761d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:08.223948 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-329f8926-c0e6-4a55-8f9e-55b57522761d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:08.232327 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-329f8926-c0e6-4a55-8f9e-55b57522761d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.167871 May 19 12:28:08.233481 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 264/501] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:08 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:08.266102 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8010be68-937d-4245-895a-e828ca13fca7 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:08.267402 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8010be68-937d-4245-895a-e828ca13fca7 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:08.277631 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8010be68-937d-4245-895a-e828ca13fca7 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:08.278331 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8010be68-937d-4245-895a-e828ca13fca7 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:08.279258 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8010be68-937d-4245-895a-e828ca13fca7 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:08.279694 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8010be68-937d-4245-895a-e828ca13fca7 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:08.357750 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8010be68-937d-4245-895a-e828ca13fca7 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:08.366662 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8010be68-937d-4245-895a-e828ca13fca7 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1218 microversion: 2.1 time: 0.106157 May 19 12:28:08.367366 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 238/502] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:08 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:08.492297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6c614465-039a-416b-900a-6deb762750ff tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:08.492925 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6c614465-039a-416b-900a-6deb762750ff tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:08.499408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c614465-039a-416b-900a-6deb762750ff tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:08.499862 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c614465-039a-416b-900a-6deb762750ff tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:08.500636 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c614465-039a-416b-900a-6deb762750ff tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:08.501075 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c614465-039a-416b-900a-6deb762750ff tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:08.642907 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6c614465-039a-416b-900a-6deb762750ff tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:08.651418 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6c614465-039a-416b-900a-6deb762750ff tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.162964 May 19 12:28:08.652632 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 265/503] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:08 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:08.711737 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7047d06e-c55e-4a88-9a3c-c4e0ac2e752e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:08.712342 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7047d06e-c55e-4a88-9a3c-c4e0ac2e752e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:08.719824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7047d06e-c55e-4a88-9a3c-c4e0ac2e752e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:08.720269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7047d06e-c55e-4a88-9a3c-c4e0ac2e752e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:08.721032 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7047d06e-c55e-4a88-9a3c-c4e0ac2e752e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:08.721460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7047d06e-c55e-4a88-9a3c-c4e0ac2e752e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:08.859226 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7047d06e-c55e-4a88-9a3c-c4e0ac2e752e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:08.867541 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7047d06e-c55e-4a88-9a3c-c4e0ac2e752e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:08.869027 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7047d06e-c55e-4a88-9a3c-c4e0ac2e752e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:08.870185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7047d06e-c55e-4a88-9a3c-c4e0ac2e752e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.162386 May 19 12:28:08.870808 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 239/504] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:08 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:09.249997 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2cb18c04-cdf6-4d46-b233-de8d50cc4dea tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:09.250735 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2cb18c04-cdf6-4d46-b233-de8d50cc4dea tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:09.257382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2cb18c04-cdf6-4d46-b233-de8d50cc4dea tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:09.257834 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2cb18c04-cdf6-4d46-b233-de8d50cc4dea tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:09.258650 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2cb18c04-cdf6-4d46-b233-de8d50cc4dea tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:09.259087 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2cb18c04-cdf6-4d46-b233-de8d50cc4dea tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:09.385505 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f9e4b91f-9429-4f51-b97b-1338af0f27f4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:09.387770 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f9e4b91f-9429-4f51-b97b-1338af0f27f4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:09.404258 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f9e4b91f-9429-4f51-b97b-1338af0f27f4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:09.410974 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f9e4b91f-9429-4f51-b97b-1338af0f27f4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:09.410974 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f9e4b91f-9429-4f51-b97b-1338af0f27f4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:09.410974 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f9e4b91f-9429-4f51-b97b-1338af0f27f4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:09.419409 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2cb18c04-cdf6-4d46-b233-de8d50cc4dea tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:09.428523 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2cb18c04-cdf6-4d46-b233-de8d50cc4dea tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.182303 May 19 12:28:09.429627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 266/505] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:09 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:09.522298 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f9e4b91f-9429-4f51-b97b-1338af0f27f4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:09.531978 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f9e4b91f-9429-4f51-b97b-1338af0f27f4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1210 microversion: 2.1 time: 0.150422 May 19 12:28:09.532980 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 240/506] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:09 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1210 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:09.672690 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a7df80c6-dac0-44db-8d61-7d73fb773ef2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:09.675146 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a7df80c6-dac0-44db-8d61-7d73fb773ef2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:09.683937 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a7df80c6-dac0-44db-8d61-7d73fb773ef2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:09.684375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a7df80c6-dac0-44db-8d61-7d73fb773ef2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:09.685213 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a7df80c6-dac0-44db-8d61-7d73fb773ef2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:09.685598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a7df80c6-dac0-44db-8d61-7d73fb773ef2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:09.775619 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-85b7627d-8e58-4e11-9265-9d35b6fef24b req-7f0f2285-9ff0-4d05-bb5b-ede353820d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70659f4e-c927-47dc-a23a-abd0db258731", "name": "network-vif-plugged", "status": "completed", "tag": "d7221580-bd77-42eb-a222-b1dd8a491c4c"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:09.788435 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-85b7627d-8e58-4e11-9265-9d35b6fef24b req-7f0f2285-9ff0-4d05-bb5b-ede353820d1c service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:09.789082 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-85b7627d-8e58-4e11-9265-9d35b6fef24b req-7f0f2285-9ff0-4d05-bb5b-ede353820d1c service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:09.802990 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-85b7627d-8e58-4e11-9265-9d35b6fef24b req-7f0f2285-9ff0-4d05-bb5b-ede353820d1c service nova] Creating event network-vif-plugged:d7221580-bd77-42eb-a222-b1dd8a491c4c for instance 70659f4e-c927-47dc-a23a-abd0db258731 on hv-cinder-77819 May 19 12:28:09.810396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-85b7627d-8e58-4e11-9265-9d35b6fef24b req-7f0f2285-9ff0-4d05-bb5b-ede353820d1c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042581 May 19 12:28:09.811070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 241/507] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:28:09.852302 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a7df80c6-dac0-44db-8d61-7d73fb773ef2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:09.864555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a7df80c6-dac0-44db-8d61-7d73fb773ef2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.197438 May 19 12:28:09.872583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 267/508] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:09 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:09.896855 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c07c17d1-d831-4244-a743-fc6b5e47bf90 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:09.897835 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c07c17d1-d831-4244-a743-fc6b5e47bf90 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:09.907322 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c07c17d1-d831-4244-a743-fc6b5e47bf90 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:09.914188 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c07c17d1-d831-4244-a743-fc6b5e47bf90 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:09.914188 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c07c17d1-d831-4244-a743-fc6b5e47bf90 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:09.914188 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c07c17d1-d831-4244-a743-fc6b5e47bf90 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:10.090991 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c07c17d1-d831-4244-a743-fc6b5e47bf90 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:10.099338 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c07c17d1-d831-4244-a743-fc6b5e47bf90 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:10.100832 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c07c17d1-d831-4244-a743-fc6b5e47bf90 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:10.101999 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c07c17d1-d831-4244-a743-fc6b5e47bf90 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.210122 May 19 12:28:10.102590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 242/509] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:09 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:10.498528 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8a61a166-19b1-435f-b883-d1e928c1e6ee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:10.498528 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8a61a166-19b1-435f-b883-d1e928c1e6ee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:10.498528 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8a61a166-19b1-435f-b883-d1e928c1e6ee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:10.498528 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8a61a166-19b1-435f-b883-d1e928c1e6ee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:10.499030 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8a61a166-19b1-435f-b883-d1e928c1e6ee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:10.499030 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8a61a166-19b1-435f-b883-d1e928c1e6ee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:10.556229 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-78c01095-e2bc-4a98-b69a-ec7520f1a77e tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:10.557119 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-78c01095-e2bc-4a98-b69a-ec7520f1a77e tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:10.566782 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-78c01095-e2bc-4a98-b69a-ec7520f1a77e tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:10.567326 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-78c01095-e2bc-4a98-b69a-ec7520f1a77e tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:10.568225 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-78c01095-e2bc-4a98-b69a-ec7520f1a77e tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:10.568670 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-78c01095-e2bc-4a98-b69a-ec7520f1a77e tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:10.616890 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8a61a166-19b1-435f-b883-d1e928c1e6ee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:10.625773 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8a61a166-19b1-435f-b883-d1e928c1e6ee tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.181878 May 19 12:28:10.626374 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 268/510] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:10 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:10.672576 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-78c01095-e2bc-4a98-b69a-ec7520f1a77e tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:10.680542 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-78c01095-e2bc-4a98-b69a-ec7520f1a77e tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1266 microversion: 2.1 time: 0.131155 May 19 12:28:10.683522 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 243/511] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:10 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:10.885035 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2c22002f-9834-4748-a48e-35bb578f9182 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:10.886481 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2c22002f-9834-4748-a48e-35bb578f9182 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:10.904029 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2c22002f-9834-4748-a48e-35bb578f9182 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:10.904480 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2c22002f-9834-4748-a48e-35bb578f9182 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:10.905271 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2c22002f-9834-4748-a48e-35bb578f9182 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:10.905703 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2c22002f-9834-4748-a48e-35bb578f9182 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:11.070237 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2c22002f-9834-4748-a48e-35bb578f9182 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:11.080200 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2c22002f-9834-4748-a48e-35bb578f9182 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.200135 May 19 12:28:11.080789 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 269/512] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:10 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:11.120430 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cd314e7c-19c3-4556-806e-7796b14f83f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:11.121309 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cd314e7c-19c3-4556-806e-7796b14f83f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:11.127962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd314e7c-19c3-4556-806e-7796b14f83f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:11.128408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd314e7c-19c3-4556-806e-7796b14f83f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:11.129258 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd314e7c-19c3-4556-806e-7796b14f83f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:11.129695 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cd314e7c-19c3-4556-806e-7796b14f83f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:11.317788 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cd314e7c-19c3-4556-806e-7796b14f83f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:11.334588 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cd314e7c-19c3-4556-806e-7796b14f83f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:11.336514 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cd314e7c-19c3-4556-806e-7796b14f83f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:11.338388 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cd314e7c-19c3-4556-806e-7796b14f83f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.221834 May 19 12:28:11.350119 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 244/513] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:11 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:11.643781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-75443f4d-54f2-47be-be24-efd49cc05686 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:11.644391 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-75443f4d-54f2-47be-be24-efd49cc05686 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:11.671220 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-75443f4d-54f2-47be-be24-efd49cc05686 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:11.672003 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-75443f4d-54f2-47be-be24-efd49cc05686 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:11.672895 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-75443f4d-54f2-47be-be24-efd49cc05686 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:11.673654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-75443f4d-54f2-47be-be24-efd49cc05686 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:11.705441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-17450163-a960-4796-a970-0465b65f0e42 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:11.706935 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-17450163-a960-4796-a970-0465b65f0e42 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:11.731632 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17450163-a960-4796-a970-0465b65f0e42 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:11.731632 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17450163-a960-4796-a970-0465b65f0e42 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:11.731632 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17450163-a960-4796-a970-0465b65f0e42 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:11.731632 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-17450163-a960-4796-a970-0465b65f0e42 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:11.819162 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-17450163-a960-4796-a970-0465b65f0e42 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:11.827554 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-17450163-a960-4796-a970-0465b65f0e42 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1284 microversion: 2.1 time: 0.127310 May 19 12:28:11.828147 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 245/514] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:11 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:11.889204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-75443f4d-54f2-47be-be24-efd49cc05686 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:11.904477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-75443f4d-54f2-47be-be24-efd49cc05686 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.259854 May 19 12:28:11.904477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 270/515] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:11 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:12.100196 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-245becd2-c5c3-4c45-a9ab-e5c94cb83311 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:12.100719 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-245becd2-c5c3-4c45-a9ab-e5c94cb83311 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:12.107071 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-245becd2-c5c3-4c45-a9ab-e5c94cb83311 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:12.107523 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-245becd2-c5c3-4c45-a9ab-e5c94cb83311 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:12.108299 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-245becd2-c5c3-4c45-a9ab-e5c94cb83311 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:12.108740 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-245becd2-c5c3-4c45-a9ab-e5c94cb83311 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:12.113275 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:12.247103 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-245becd2-c5c3-4c45-a9ab-e5c94cb83311 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:12.256324 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-245becd2-c5c3-4c45-a9ab-e5c94cb83311 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.160853 May 19 12:28:12.257098 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 246/516] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:12 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:12.381459 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f35012c0-2e65-451e-aee1-d5e1834f990d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:12.382640 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f35012c0-2e65-451e-aee1-d5e1834f990d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:12.395370 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f35012c0-2e65-451e-aee1-d5e1834f990d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:12.396319 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f35012c0-2e65-451e-aee1-d5e1834f990d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:12.397739 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f35012c0-2e65-451e-aee1-d5e1834f990d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:12.398590 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f35012c0-2e65-451e-aee1-d5e1834f990d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:12.583596 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f35012c0-2e65-451e-aee1-d5e1834f990d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:12.604532 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f35012c0-2e65-451e-aee1-d5e1834f990d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:12.604532 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f35012c0-2e65-451e-aee1-d5e1834f990d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:12.604532 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f35012c0-2e65-451e-aee1-d5e1834f990d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.221602 May 19 12:28:12.605581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 271/517] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:12 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:12.847401 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-285aed52-5653-4a4e-aa92-6c5323537bf3 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:12.848551 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-285aed52-5653-4a4e-aa92-6c5323537bf3 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:12.856935 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-285aed52-5653-4a4e-aa92-6c5323537bf3 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:12.857451 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-285aed52-5653-4a4e-aa92-6c5323537bf3 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:12.858303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-285aed52-5653-4a4e-aa92-6c5323537bf3 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:12.859047 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-285aed52-5653-4a4e-aa92-6c5323537bf3 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:12.925037 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b9359300-2d8d-4c2b-8823-0c6e3d4a88e3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:12.927689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b9359300-2d8d-4c2b-8823-0c6e3d4a88e3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:12.935998 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-285aed52-5653-4a4e-aa92-6c5323537bf3 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:12.942899 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b9359300-2d8d-4c2b-8823-0c6e3d4a88e3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:12.943941 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b9359300-2d8d-4c2b-8823-0c6e3d4a88e3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:12.944577 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-285aed52-5653-4a4e-aa92-6c5323537bf3 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1272 microversion: 2.1 time: 0.102732 May 19 12:28:12.945389 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 247/518] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:12 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:12.946547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b9359300-2d8d-4c2b-8823-0c6e3d4a88e3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:12.947557 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b9359300-2d8d-4c2b-8823-0c6e3d4a88e3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:13.192131 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b9359300-2d8d-4c2b-8823-0c6e3d4a88e3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:13.201342 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b9359300-2d8d-4c2b-8823-0c6e3d4a88e3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1357 microversion: 2.1 time: 0.285083 May 19 12:28:13.202082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 272/519] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:12 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1357 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:13.275055 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fef8e6c6-ad0e-4b43-b8a2-48dd72681fe8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:13.275611 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fef8e6c6-ad0e-4b43-b8a2-48dd72681fe8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:13.285503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fef8e6c6-ad0e-4b43-b8a2-48dd72681fe8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:13.285954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fef8e6c6-ad0e-4b43-b8a2-48dd72681fe8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:13.286654 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fef8e6c6-ad0e-4b43-b8a2-48dd72681fe8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:13.287092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fef8e6c6-ad0e-4b43-b8a2-48dd72681fe8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:13.456617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-fef8e6c6-ad0e-4b43-b8a2-48dd72681fe8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:13.465298 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fef8e6c6-ad0e-4b43-b8a2-48dd72681fe8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.194107 May 19 12:28:13.467792 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 248/520] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:13 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:13.614531 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6bd95021-5849-4884-9ba5-313d1b7f2d35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:13.615159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6bd95021-5849-4884-9ba5-313d1b7f2d35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:13.622266 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6bd95021-5849-4884-9ba5-313d1b7f2d35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:13.622754 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6bd95021-5849-4884-9ba5-313d1b7f2d35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:13.624789 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6bd95021-5849-4884-9ba5-313d1b7f2d35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:13.624789 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6bd95021-5849-4884-9ba5-313d1b7f2d35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:13.820655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6bd95021-5849-4884-9ba5-313d1b7f2d35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:13.833631 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6bd95021-5849-4884-9ba5-313d1b7f2d35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:13.839045 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6bd95021-5849-4884-9ba5-313d1b7f2d35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:13.840203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6bd95021-5849-4884-9ba5-313d1b7f2d35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.229638 May 19 12:28:13.841447 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 273/521] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:13 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:13.963225 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-210b7c26-1755-47e0-aff0-f495e6375dcb tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:13.963920 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-210b7c26-1755-47e0-aff0-f495e6375dcb tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:13.971881 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-210b7c26-1755-47e0-aff0-f495e6375dcb tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:13.972371 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-210b7c26-1755-47e0-aff0-f495e6375dcb tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:13.973146 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-210b7c26-1755-47e0-aff0-f495e6375dcb tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:13.973588 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-210b7c26-1755-47e0-aff0-f495e6375dcb tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.118562 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-210b7c26-1755-47e0-aff0-f495e6375dcb tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:14.127038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-210b7c26-1755-47e0-aff0-f495e6375dcb tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1314 microversion: 2.1 time: 0.167863 May 19 12:28:14.127600 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 249/522] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:13 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:14.220205 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fe497d0f-f390-431d-90cb-076e3c8bb816 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:14.221549 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fe497d0f-f390-431d-90cb-076e3c8bb816 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:14.228462 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe497d0f-f390-431d-90cb-076e3c8bb816 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.228954 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe497d0f-f390-431d-90cb-076e3c8bb816 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.230454 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe497d0f-f390-431d-90cb-076e3c8bb816 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.231200 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe497d0f-f390-431d-90cb-076e3c8bb816 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.236592 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:14.388608 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fe497d0f-f390-431d-90cb-076e3c8bb816 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:14.397144 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fe497d0f-f390-431d-90cb-076e3c8bb816 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1548 microversion: 2.1 time: 0.182004 May 19 12:28:14.398029 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 274/523] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:14 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:14.416082 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a5906fae-6741-41c7-9b7d-c1f09b9be66b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:14.416811 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a5906fae-6741-41c7-9b7d-c1f09b9be66b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:14.426662 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a5906fae-6741-41c7-9b7d-c1f09b9be66b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.427826 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a5906fae-6741-41c7-9b7d-c1f09b9be66b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.428396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a5906fae-6741-41c7-9b7d-c1f09b9be66b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.428864 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a5906fae-6741-41c7-9b7d-c1f09b9be66b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.484736 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a20fb276-18f6-4094-a5ec-41c8d34f611b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:14.485632 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a20fb276-18f6-4094-a5ec-41c8d34f611b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:14.493213 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a20fb276-18f6-4094-a5ec-41c8d34f611b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.493966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a20fb276-18f6-4094-a5ec-41c8d34f611b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.494958 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a20fb276-18f6-4094-a5ec-41c8d34f611b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.496070 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a20fb276-18f6-4094-a5ec-41c8d34f611b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.642927 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a5906fae-6741-41c7-9b7d-c1f09b9be66b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:14.652845 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a5906fae-6741-41c7-9b7d-c1f09b9be66b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1548 microversion: 2.1 time: 0.240733 May 19 12:28:14.653989 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 250/524] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:14 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1548 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:14.670782 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-40364561-5590-4da6-8ef3-348c38156e8a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:14.674482 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-40364561-5590-4da6-8ef3-348c38156e8a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:14.675269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-40364561-5590-4da6-8ef3-348c38156e8a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Searching by: {'deleted': False, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f'} {{(pid=118111) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 12:28:14.683401 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40364561-5590-4da6-8ef3-348c38156e8a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.685146 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40364561-5590-4da6-8ef3-348c38156e8a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.685146 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40364561-5590-4da6-8ef3-348c38156e8a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.685146 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40364561-5590-4da6-8ef3-348c38156e8a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.688114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a20fb276-18f6-4094-a5ec-41c8d34f611b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:14.699218 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a20fb276-18f6-4094-a5ec-41c8d34f611b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.219979 May 19 12:28:14.699823 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 275/525] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:14 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:14.790454 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.multi_cell_list [None req-40364561-5590-4da6-8ef3-348c38156e8a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118111) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 12:28:14.811302 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-d98dc72e-0dc6-45ac-a216-62b22f80e13a req-dac141e2-c2f6-4fe5-8ba4-028931047461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2eeef31-7890-43bf-83fe-7674f49f53a0", "tag": "452993dd-560e-4269-adb0-b9a0b4d301d3"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:14.824558 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-d98dc72e-0dc6-45ac-a216-62b22f80e13a req-dac141e2-c2f6-4fe5-8ba4-028931047461 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.825691 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-d98dc72e-0dc6-45ac-a216-62b22f80e13a req-dac141e2-c2f6-4fe5-8ba4-028931047461 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.856289 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-d98dc72e-0dc6-45ac-a216-62b22f80e13a req-dac141e2-c2f6-4fe5-8ba4-028931047461 service nova] Creating event network-changed:452993dd-560e-4269-adb0-b9a0b4d301d3 for instance d2eeef31-7890-43bf-83fe-7674f49f53a0 on hv-cinder-77819 May 19 12:28:14.861754 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-d98dc72e-0dc6-45ac-a216-62b22f80e13a req-dac141e2-c2f6-4fe5-8ba4-028931047461 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055275 May 19 12:28:14.862820 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 276/526] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:14.873765 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f4e455ac-66c1-4968-aaf0-f847d20340a3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:14.874497 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f4e455ac-66c1-4968-aaf0-f847d20340a3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:14.881380 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f4e455ac-66c1-4968-aaf0-f847d20340a3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.882122 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f4e455ac-66c1-4968-aaf0-f847d20340a3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.883142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f4e455ac-66c1-4968-aaf0-f847d20340a3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.883824 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f4e455ac-66c1-4968-aaf0-f847d20340a3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.911600 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-40364561-5590-4da6-8ef3-348c38156e8a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.245639 May 19 12:28:14.913826 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 251/527] 10.222.0.57 () {58 vars in 1124 bytes} [Thu May 19 12:28:14 2022] GET /compute/v2.1/servers => generated 342 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:28:14.923335 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-28e73232-357f-472d-895b-778de268e8a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:14.924238 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-28e73232-357f-472d-895b-778de268e8a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:14.930967 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28e73232-357f-472d-895b-778de268e8a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.931417 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28e73232-357f-472d-895b-778de268e8a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:14.932192 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28e73232-357f-472d-895b-778de268e8a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:14.932639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28e73232-357f-472d-895b-778de268e8a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:15.046569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:15.134671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f4e455ac-66c1-4968-aaf0-f847d20340a3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:15.145711 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f4e455ac-66c1-4968-aaf0-f847d20340a3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:15.145711 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f4e455ac-66c1-4968-aaf0-f847d20340a3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:15.146661 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f4e455ac-66c1-4968-aaf0-f847d20340a3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.282421 May 19 12:28:15.147074 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 277/528] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:14 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:15.147576 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-28e73232-357f-472d-895b-778de268e8a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:15.152574 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b153b574-afb4-40a6-8cbc-aa1806b4c787 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:15.153187 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b153b574-afb4-40a6-8cbc-aa1806b4c787 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:15.156459 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-28e73232-357f-472d-895b-778de268e8a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1548 microversion: 2.1 time: 0.237125 May 19 12:28:15.157042 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 252/529] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:14 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1548 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:15.162355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b153b574-afb4-40a6-8cbc-aa1806b4c787 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:15.162355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b153b574-afb4-40a6-8cbc-aa1806b4c787 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:15.162355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b153b574-afb4-40a6-8cbc-aa1806b4c787 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:15.162355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b153b574-afb4-40a6-8cbc-aa1806b4c787 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:15.340930 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b153b574-afb4-40a6-8cbc-aa1806b4c787 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:15.352820 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b153b574-afb4-40a6-8cbc-aa1806b4c787 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1314 microversion: 2.1 time: 0.204365 May 19 12:28:15.353421 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 278/530] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:15 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:15.718912 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-055e0cd6-f86e-4639-9a7d-199162bef4b1 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:15.720192 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-055e0cd6-f86e-4639-9a7d-199162bef4b1 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:15.732514 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-055e0cd6-f86e-4639-9a7d-199162bef4b1 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:15.733015 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-055e0cd6-f86e-4639-9a7d-199162bef4b1 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:15.733920 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-055e0cd6-f86e-4639-9a7d-199162bef4b1 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:15.734360 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-055e0cd6-f86e-4639-9a7d-199162bef4b1 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:15.900398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-055e0cd6-f86e-4639-9a7d-199162bef4b1 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:15.910073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-055e0cd6-f86e-4639-9a7d-199162bef4b1 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.195961 May 19 12:28:15.910825 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 253/531] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:15 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:16.171441 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3ee7ab44-8b7a-4167-b3bb-77cbb47c4708 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:16.173129 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3ee7ab44-8b7a-4167-b3bb-77cbb47c4708 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:16.183445 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3ee7ab44-8b7a-4167-b3bb-77cbb47c4708 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:16.184954 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3ee7ab44-8b7a-4167-b3bb-77cbb47c4708 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:16.195826 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3ee7ab44-8b7a-4167-b3bb-77cbb47c4708 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:16.197204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3ee7ab44-8b7a-4167-b3bb-77cbb47c4708 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:16.372982 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-640d554f-5411-4b37-890e-ff6893c91db4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:16.373623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-640d554f-5411-4b37-890e-ff6893c91db4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:16.376069 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=8 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:16.389891 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-640d554f-5411-4b37-890e-ff6893c91db4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:16.390353 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-640d554f-5411-4b37-890e-ff6893c91db4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:16.391271 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-640d554f-5411-4b37-890e-ff6893c91db4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:16.391713 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-640d554f-5411-4b37-890e-ff6893c91db4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:16.405184 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3ee7ab44-8b7a-4167-b3bb-77cbb47c4708 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:16.427498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3ee7ab44-8b7a-4167-b3bb-77cbb47c4708 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:16.440967 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3ee7ab44-8b7a-4167-b3bb-77cbb47c4708 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:16.443421 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3ee7ab44-8b7a-4167-b3bb-77cbb47c4708 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1744 microversion: 2.20 time: 0.280654 May 19 12:28:16.448992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 279/532] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:16 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1744 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:16.613520 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-640d554f-5411-4b37-890e-ff6893c91db4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:16.624595 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-640d554f-5411-4b37-890e-ff6893c91db4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1314 microversion: 2.1 time: 0.256171 May 19 12:28:16.625448 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 254/533] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:16 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:16.929781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8e3c31f5-32f9-4394-a736-8c6d1ded8aec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:16.930420 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8e3c31f5-32f9-4394-a736-8c6d1ded8aec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:16.937800 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8e3c31f5-32f9-4394-a736-8c6d1ded8aec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:16.938305 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8e3c31f5-32f9-4394-a736-8c6d1ded8aec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:16.939169 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8e3c31f5-32f9-4394-a736-8c6d1ded8aec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:16.939602 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8e3c31f5-32f9-4394-a736-8c6d1ded8aec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:17.121327 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8e3c31f5-32f9-4394-a736-8c6d1ded8aec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:17.130621 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8e3c31f5-32f9-4394-a736-8c6d1ded8aec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.204963 May 19 12:28:17.141326 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 280/534] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:16 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:17.222924 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3c976764-85d9-4ba9-adb8-c9d3ee25da7d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Action: 'create', calling method: .version_select at 0x7fd45500aaf0>, body: {"keypair": {"name": "tempest-keypair-1175638416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjqv21IHcn41jctgNIxioVLugn9pYudWPixPIf9RGNbBoPz6HNrWwbZbruRP3+a50rr10AYch5q9hdZKjk82AGmh94unDbx2kg8SQWBjLcbY0jRlpymxqJO8LvNAvL6mA=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:17.238033 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-3c976764-85d9-4ba9-adb8-c9d3ee25da7d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for project 86c353f6ded643e6b501ec57800fafc6. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:28:17.242098 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-3c976764-85d9-4ba9-adb8-c9d3ee25da7d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for user f0a98f1c068843a684f6765d41cc4e49 and project 86c353f6ded643e6b501ec57800fafc6. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:28:17.346885 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3c976764-85d9-4ba9-adb8-c9d3ee25da7d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.127907 May 19 12:28:17.348253 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 255/535] 10.222.0.57 () {60 vars in 1158 bytes} [Thu May 19 12:28:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:17.488575 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-bb0ecb23-5aaa-4b4b-8a7d-c96623733364 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:17.490837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-bb0ecb23-5aaa-4b4b-8a7d-c96623733364 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:17.504535 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bb0ecb23-5aaa-4b4b-8a7d-c96623733364 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:17.505637 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bb0ecb23-5aaa-4b4b-8a7d-c96623733364 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:17.507882 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bb0ecb23-5aaa-4b4b-8a7d-c96623733364 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:17.510401 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bb0ecb23-5aaa-4b4b-8a7d-c96623733364 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:17.643609 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5d09f9e5-00cd-4c67-9baa-326559517757 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:17.644383 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5d09f9e5-00cd-4c67-9baa-326559517757 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:17.648144 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:17.654043 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d09f9e5-00cd-4c67-9baa-326559517757 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:17.654714 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d09f9e5-00cd-4c67-9baa-326559517757 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:17.655721 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d09f9e5-00cd-4c67-9baa-326559517757 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:17.656505 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d09f9e5-00cd-4c67-9baa-326559517757 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:17.740973 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bb0ecb23-5aaa-4b4b-8a7d-c96623733364 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:17.751697 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bb0ecb23-5aaa-4b4b-8a7d-c96623733364 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:17.753495 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bb0ecb23-5aaa-4b4b-8a7d-c96623733364 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:17.754939 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-bb0ecb23-5aaa-4b4b-8a7d-c96623733364 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1744 microversion: 2.20 time: 0.276849 May 19 12:28:17.756139 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 281/536] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:17 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1744 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:17.768187 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-89dd9241-f514-48b2-a27d-c4816960b905 req-c58783c9-a3c0-46ab-a0b5-62cb1631dc8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac0842f-dd21-479d-894c-1080f1531013", "name": "network-vif-plugged", "status": "completed", "tag": "2ce047fc-9ae8-4336-a545-1e048200c75a"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:17.783892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-89dd9241-f514-48b2-a27d-c4816960b905 req-c58783c9-a3c0-46ab-a0b5-62cb1631dc8e service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:17.784491 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-89dd9241-f514-48b2-a27d-c4816960b905 req-c58783c9-a3c0-46ab-a0b5-62cb1631dc8e service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:17.797268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-89dd9241-f514-48b2-a27d-c4816960b905 req-c58783c9-a3c0-46ab-a0b5-62cb1631dc8e service nova] Creating event network-vif-plugged:2ce047fc-9ae8-4336-a545-1e048200c75a for instance 1ac0842f-dd21-479d-894c-1080f1531013 on hv-cinder-77819 May 19 12:28:17.803803 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-89dd9241-f514-48b2-a27d-c4816960b905 req-c58783c9-a3c0-46ab-a0b5-62cb1631dc8e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046195 May 19 12:28:17.804834 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 282/537] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:17.836740 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5d09f9e5-00cd-4c67-9baa-326559517757 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:17.845351 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5d09f9e5-00cd-4c67-9baa-326559517757 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1314 microversion: 2.1 time: 0.207134 May 19 12:28:17.845351 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 256/538] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:17 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:18.149795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b8af1dfa-61fc-498d-9c57-46bd8bb4b27b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:18.150396 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b8af1dfa-61fc-498d-9c57-46bd8bb4b27b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:18.159722 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b8af1dfa-61fc-498d-9c57-46bd8bb4b27b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:18.160554 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b8af1dfa-61fc-498d-9c57-46bd8bb4b27b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:18.161939 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b8af1dfa-61fc-498d-9c57-46bd8bb4b27b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:18.162817 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b8af1dfa-61fc-498d-9c57-46bd8bb4b27b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:18.322683 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b8af1dfa-61fc-498d-9c57-46bd8bb4b27b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:18.333084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b8af1dfa-61fc-498d-9c57-46bd8bb4b27b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.187577 May 19 12:28:18.334318 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 283/539] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:18 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:18.402316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cebf4822-535f-4ed3-bfe3-6776eef719ff tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a2e6a4a-7533-466e-81a5-fe22e66e23dd"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:18.403354 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cebf4822-535f-4ed3-bfe3-6776eef719ff tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:18.409921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cebf4822-535f-4ed3-bfe3-6776eef719ff tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:18.410368 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cebf4822-535f-4ed3-bfe3-6776eef719ff tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:18.411292 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cebf4822-535f-4ed3-bfe3-6776eef719ff tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:18.411927 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cebf4822-535f-4ed3-bfe3-6776eef719ff tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:18.788963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-bbd57295-7c55-4ee8-9607-5ef80d3b7040 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:18.789680 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-bbd57295-7c55-4ee8-9607-5ef80d3b7040 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:18.796900 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bbd57295-7c55-4ee8-9607-5ef80d3b7040 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:18.797344 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bbd57295-7c55-4ee8-9607-5ef80d3b7040 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:18.798167 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bbd57295-7c55-4ee8-9607-5ef80d3b7040 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:18.798697 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bbd57295-7c55-4ee8-9607-5ef80d3b7040 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:18.940900 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bbd57295-7c55-4ee8-9607-5ef80d3b7040 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:18.951600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bbd57295-7c55-4ee8-9607-5ef80d3b7040 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:18.953117 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bbd57295-7c55-4ee8-9607-5ef80d3b7040 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:18.954447 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-bbd57295-7c55-4ee8-9607-5ef80d3b7040 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1744 microversion: 2.20 time: 0.169500 May 19 12:28:18.955018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 284/540] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:18 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:18.959799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-07b99b6d-a131-4173-a1f8-7042bf0a7f2a tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:18.960752 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-07b99b6d-a131-4173-a1f8-7042bf0a7f2a tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:18.968862 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-07b99b6d-a131-4173-a1f8-7042bf0a7f2a tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:18.974270 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-07b99b6d-a131-4173-a1f8-7042bf0a7f2a tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:18.974270 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-07b99b6d-a131-4173-a1f8-7042bf0a7f2a tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:18.974270 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-07b99b6d-a131-4173-a1f8-7042bf0a7f2a tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:19.139031 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-07b99b6d-a131-4173-a1f8-7042bf0a7f2a tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:19.150577 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-07b99b6d-a131-4173-a1f8-7042bf0a7f2a tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1314 microversion: 2.1 time: 0.193969 May 19 12:28:19.152134 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 285/541] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:18 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:19.363240 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8a3c78d3-bd5a-4eef-9a0f-60648134d5d2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:19.363838 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8a3c78d3-bd5a-4eef-9a0f-60648134d5d2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:19.370239 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8a3c78d3-bd5a-4eef-9a0f-60648134d5d2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:19.370703 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8a3c78d3-bd5a-4eef-9a0f-60648134d5d2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:19.371806 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8a3c78d3-bd5a-4eef-9a0f-60648134d5d2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:19.372776 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8a3c78d3-bd5a-4eef-9a0f-60648134d5d2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:19.528716 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8a3c78d3-bd5a-4eef-9a0f-60648134d5d2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:19.538966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8a3c78d3-bd5a-4eef-9a0f-60648134d5d2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.179141 May 19 12:28:19.539768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 286/542] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:19 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:19.973032 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0d09325e-6f76-4a8f-9ab5-d3d0e565de7a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:19.973690 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0d09325e-6f76-4a8f-9ab5-d3d0e565de7a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:19.980437 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0d09325e-6f76-4a8f-9ab5-d3d0e565de7a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:19.980886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0d09325e-6f76-4a8f-9ab5-d3d0e565de7a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:19.981652 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0d09325e-6f76-4a8f-9ab5-d3d0e565de7a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:19.982086 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0d09325e-6f76-4a8f-9ab5-d3d0e565de7a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:20.137079 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0d09325e-6f76-4a8f-9ab5-d3d0e565de7a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:20.145100 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0d09325e-6f76-4a8f-9ab5-d3d0e565de7a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:20.146619 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0d09325e-6f76-4a8f-9ab5-d3d0e565de7a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:20.147759 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0d09325e-6f76-4a8f-9ab5-d3d0e565de7a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1744 microversion: 2.20 time: 0.178687 May 19 12:28:20.148325 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 287/543] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:19 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:20.169004 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-396830ec-6d4f-43f9-b126-8951d908d9f9 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:20.169598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-396830ec-6d4f-43f9-b126-8951d908d9f9 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:20.175746 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-396830ec-6d4f-43f9-b126-8951d908d9f9 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:20.176324 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-396830ec-6d4f-43f9-b126-8951d908d9f9 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:20.177400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-396830ec-6d4f-43f9-b126-8951d908d9f9 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:20.177689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-396830ec-6d4f-43f9-b126-8951d908d9f9 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:20.321321 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-396830ec-6d4f-43f9-b126-8951d908d9f9 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:20.330056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-396830ec-6d4f-43f9-b126-8951d908d9f9 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1314 microversion: 2.1 time: 0.165394 May 19 12:28:20.341334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 288/544] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:20 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:20.381731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-920074303", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9b89124-2c1b-4572-adaf-f3ca44cc01f0"}], "security_groups": [{"name": "tempest-securitygroup--1905210558"}], "key_name": "tempest-keypair-1175638416", "user_data": "}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:20.488510 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.network.neutron [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] validate_networks() for [('c9b89124-2c1b-4572-adaf-f3ca44cc01f0', None, None, None, None, None)] {{(pid=118112) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:28:20.906533 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Flavor limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:28:20.906965 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Image limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:28:20.907464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Flavor pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:28:20.907866 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Image pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:28:20.908276 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:28:20.917950 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:20.918462 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:20.919266 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:20.919696 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:20.939090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for project 86c353f6ded643e6b501ec57800fafc6. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:28:20.943276 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for user f0a98f1c068843a684f6765d41cc4e49 and project 86c353f6ded643e6b501ec57800fafc6. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:28:20.957032 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Going to run 1 instances... {{(pid=118112) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:28:20.959375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:28:21.223771 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9bed7b80-5ca5-4ed5-b5d4-c5c1327a52d6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.846109 May 19 12:28:21.227516 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 289/545] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:28:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 12:28:21.232970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1b431c1e-8713-49af-9c8d-9df891dd2711 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:21.233575 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1b431c1e-8713-49af-9c8d-9df891dd2711 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:21.241599 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1b431c1e-8713-49af-9c8d-9df891dd2711 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:21.242107 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1b431c1e-8713-49af-9c8d-9df891dd2711 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:21.242920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1b431c1e-8713-49af-9c8d-9df891dd2711 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:21.246684 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1b431c1e-8713-49af-9c8d-9df891dd2711 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:21.413225 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1b431c1e-8713-49af-9c8d-9df891dd2711 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:21.422773 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1b431c1e-8713-49af-9c8d-9df891dd2711 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.193926 May 19 12:28:21.423443 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 290/546] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:21 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:21.428536 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2cdc19df-56cf-4e75-8c10-f27bedcdcc6e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:21.429281 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2cdc19df-56cf-4e75-8c10-f27bedcdcc6e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:21.436258 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2cdc19df-56cf-4e75-8c10-f27bedcdcc6e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:21.436706 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2cdc19df-56cf-4e75-8c10-f27bedcdcc6e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:21.437515 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2cdc19df-56cf-4e75-8c10-f27bedcdcc6e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:21.437948 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2cdc19df-56cf-4e75-8c10-f27bedcdcc6e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:21.575406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2cdc19df-56cf-4e75-8c10-f27bedcdcc6e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:21.583496 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2cdc19df-56cf-4e75-8c10-f27bedcdcc6e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:21.584981 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2cdc19df-56cf-4e75-8c10-f27bedcdcc6e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:21.586137 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2cdc19df-56cf-4e75-8c10-f27bedcdcc6e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1744 microversion: 2.20 time: 0.161649 May 19 12:28:21.586725 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 291/547] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:21 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:21.591359 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-686fd061-0485-407d-9c01-98f5d72f7168 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:21.591953 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-686fd061-0485-407d-9c01-98f5d72f7168 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:21.646438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-686fd061-0485-407d-9c01-98f5d72f7168 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:21.656349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-686fd061-0485-407d-9c01-98f5d72f7168 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1241 microversion: 2.1 time: 0.068536 May 19 12:28:21.656931 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 292/548] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:21 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:21.661484 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-69e64250-1520-4338-b5df-c02060d30fab tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:21.662092 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-69e64250-1520-4338-b5df-c02060d30fab tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:21.680145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-69e64250-1520-4338-b5df-c02060d30fab tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:21.680145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-69e64250-1520-4338-b5df-c02060d30fab tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:21.680145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-69e64250-1520-4338-b5df-c02060d30fab tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:21.680145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-69e64250-1520-4338-b5df-c02060d30fab tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:21.746185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cebf4822-535f-4ed3-bfe3-6776eef719ff tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "POST /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.346969 May 19 12:28:21.748163 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 257/549] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:28:18 2022] POST /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/os-volume_attachments => generated 194 bytes in 3351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:21.858592 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-69e64250-1520-4338-b5df-c02060d30fab tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:21.861004 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:21.868095 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-69e64250-1520-4338-b5df-c02060d30fab tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1314 microversion: 2.1 time: 0.210109 May 19 12:28:21.871481 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 293/550] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:21 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:22.442877 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4d2b8911-393c-4b85-963d-49b9a9d297f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:22.443958 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4d2b8911-393c-4b85-963d-49b9a9d297f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:22.457599 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d2b8911-393c-4b85-963d-49b9a9d297f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:22.458736 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d2b8911-393c-4b85-963d-49b9a9d297f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:22.459987 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d2b8911-393c-4b85-963d-49b9a9d297f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:22.461097 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4d2b8911-393c-4b85-963d-49b9a9d297f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:22.505220 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-e0f1f48f-486d-434b-95c6-c8cd2cb89701 req-fb0c4f16-6fb4-4053-9b8f-210afb4206ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2eeef31-7890-43bf-83fe-7674f49f53a0", "name": "network-vif-plugged", "status": "completed", "tag": "452993dd-560e-4269-adb0-b9a0b4d301d3"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:22.519910 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-e0f1f48f-486d-434b-95c6-c8cd2cb89701 req-fb0c4f16-6fb4-4053-9b8f-210afb4206ae service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:22.520689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-e0f1f48f-486d-434b-95c6-c8cd2cb89701 req-fb0c4f16-6fb4-4053-9b8f-210afb4206ae service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:22.534297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-e0f1f48f-486d-434b-95c6-c8cd2cb89701 req-fb0c4f16-6fb4-4053-9b8f-210afb4206ae service nova] Creating event network-vif-plugged:452993dd-560e-4269-adb0-b9a0b4d301d3 for instance d2eeef31-7890-43bf-83fe-7674f49f53a0 on hv-cinder-77819 May 19 12:28:22.539896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-e0f1f48f-486d-434b-95c6-c8cd2cb89701 req-fb0c4f16-6fb4-4053-9b8f-210afb4206ae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038408 May 19 12:28:22.540854 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 294/551] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:22.607705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-77a1abe8-4e5b-462c-b2ef-80a8bc2197f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:22.608801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-77a1abe8-4e5b-462c-b2ef-80a8bc2197f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:22.617208 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-77a1abe8-4e5b-462c-b2ef-80a8bc2197f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:22.618099 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-77a1abe8-4e5b-462c-b2ef-80a8bc2197f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:22.619214 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-77a1abe8-4e5b-462c-b2ef-80a8bc2197f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:22.620465 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-77a1abe8-4e5b-462c-b2ef-80a8bc2197f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:22.644408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4d2b8911-393c-4b85-963d-49b9a9d297f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:22.657166 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4d2b8911-393c-4b85-963d-49b9a9d297f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.218916 May 19 12:28:22.659231 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 258/552] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:22 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:22.675752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e21e3159-9666-4614-9201-a24f6bddbe42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:22.677572 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e21e3159-9666-4614-9201-a24f6bddbe42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:22.689689 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e21e3159-9666-4614-9201-a24f6bddbe42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:22.691028 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e21e3159-9666-4614-9201-a24f6bddbe42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:22.692344 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e21e3159-9666-4614-9201-a24f6bddbe42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:22.693085 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e21e3159-9666-4614-9201-a24f6bddbe42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:22.793160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e21e3159-9666-4614-9201-a24f6bddbe42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:22.809509 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e21e3159-9666-4614-9201-a24f6bddbe42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1245 microversion: 2.1 time: 0.139779 May 19 12:28:22.810179 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 259/553] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:22 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1245 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:22.862149 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-77a1abe8-4e5b-462c-b2ef-80a8bc2197f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:22.872313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-77a1abe8-4e5b-462c-b2ef-80a8bc2197f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:22.873854 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-77a1abe8-4e5b-462c-b2ef-80a8bc2197f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:22.875229 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-77a1abe8-4e5b-462c-b2ef-80a8bc2197f9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1744 microversion: 2.20 time: 0.272638 May 19 12:28:22.875799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 295/554] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:22 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1744 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:22.898086 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4f281a4c-30b4-4706-ac93-d9d060ef36fc tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:22.903944 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4f281a4c-30b4-4706-ac93-d9d060ef36fc tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:22.913123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4f281a4c-30b4-4706-ac93-d9d060ef36fc tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:22.913773 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4f281a4c-30b4-4706-ac93-d9d060ef36fc tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:22.914674 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4f281a4c-30b4-4706-ac93-d9d060ef36fc tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:22.915024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4f281a4c-30b4-4706-ac93-d9d060ef36fc tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:23.096812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4f281a4c-30b4-4706-ac93-d9d060ef36fc tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:23.100097 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4f281a4c-30b4-4706-ac93-d9d060ef36fc tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1314 microversion: 2.1 time: 0.208994 May 19 12:28:23.100497 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 260/555] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:22 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:23.676006 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f76ab2ed-1f6f-4256-9b5b-6a626e878666 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:23.677913 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f76ab2ed-1f6f-4256-9b5b-6a626e878666 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:23.679620 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:23.684675 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f76ab2ed-1f6f-4256-9b5b-6a626e878666 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:23.685127 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f76ab2ed-1f6f-4256-9b5b-6a626e878666 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:23.685906 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f76ab2ed-1f6f-4256-9b5b-6a626e878666 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:23.686360 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f76ab2ed-1f6f-4256-9b5b-6a626e878666 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:23.828829 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-74ee5dd9-e6f7-4f29-99cb-714b11efa5e9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:23.828829 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-74ee5dd9-e6f7-4f29-99cb-714b11efa5e9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:23.835128 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-74ee5dd9-e6f7-4f29-99cb-714b11efa5e9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:23.835771 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-74ee5dd9-e6f7-4f29-99cb-714b11efa5e9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:23.836657 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-74ee5dd9-e6f7-4f29-99cb-714b11efa5e9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:23.837118 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-74ee5dd9-e6f7-4f29-99cb-714b11efa5e9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:23.856629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f76ab2ed-1f6f-4256-9b5b-6a626e878666 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:23.865611 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f76ab2ed-1f6f-4256-9b5b-6a626e878666 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.193390 May 19 12:28:23.866420 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 296/556] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:23 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:23.895878 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2113da1f-62c1-4662-9ec4-aa79367f9f5d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:23.896661 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2113da1f-62c1-4662-9ec4-aa79367f9f5d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:23.905432 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2113da1f-62c1-4662-9ec4-aa79367f9f5d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:23.906045 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-74ee5dd9-e6f7-4f29-99cb-714b11efa5e9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:23.906200 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2113da1f-62c1-4662-9ec4-aa79367f9f5d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:23.907102 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2113da1f-62c1-4662-9ec4-aa79367f9f5d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:23.907646 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2113da1f-62c1-4662-9ec4-aa79367f9f5d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:23.916059 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-74ee5dd9-e6f7-4f29-99cb-714b11efa5e9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1293 microversion: 2.1 time: 0.093683 May 19 12:28:23.926601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 261/557] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:23 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:24.066805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2113da1f-62c1-4662-9ec4-aa79367f9f5d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:24.080353 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2113da1f-62c1-4662-9ec4-aa79367f9f5d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:24.082029 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2113da1f-62c1-4662-9ec4-aa79367f9f5d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:24.083600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2113da1f-62c1-4662-9ec4-aa79367f9f5d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1744 microversion: 2.20 time: 0.191559 May 19 12:28:24.084208 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 297/558] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:23 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:24.118734 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-afd90578-a50b-4cb0-9160-8da0297e25ca tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:24.119415 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-afd90578-a50b-4cb0-9160-8da0297e25ca tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:24.126960 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-afd90578-a50b-4cb0-9160-8da0297e25ca tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:24.127412 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-afd90578-a50b-4cb0-9160-8da0297e25ca tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:24.128182 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-afd90578-a50b-4cb0-9160-8da0297e25ca tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:24.128612 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-afd90578-a50b-4cb0-9160-8da0297e25ca tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:24.133702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:24.273700 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-afd90578-a50b-4cb0-9160-8da0297e25ca tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:24.282931 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-afd90578-a50b-4cb0-9160-8da0297e25ca tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1314 microversion: 2.1 time: 0.169039 May 19 12:28:24.283506 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 262/559] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:24 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:24.887583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-74de3808-bdf5-4489-ba90-9d324258e8f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:24.887583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-74de3808-bdf5-4489-ba90-9d324258e8f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:24.892382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-74de3808-bdf5-4489-ba90-9d324258e8f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:24.892960 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-74de3808-bdf5-4489-ba90-9d324258e8f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:24.894510 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-74de3808-bdf5-4489-ba90-9d324258e8f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:24.894510 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-74de3808-bdf5-4489-ba90-9d324258e8f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:24.933798 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9d089152-85de-40cc-ad60-256655e3d2ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:24.934500 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9d089152-85de-40cc-ad60-256655e3d2ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:24.937410 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:24.941900 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d089152-85de-40cc-ad60-256655e3d2ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:24.942362 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d089152-85de-40cc-ad60-256655e3d2ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:24.943171 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d089152-85de-40cc-ad60-256655e3d2ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:24.943608 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d089152-85de-40cc-ad60-256655e3d2ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:25.025117 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9d089152-85de-40cc-ad60-256655e3d2ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:25.037316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9d089152-85de-40cc-ad60-256655e3d2ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1301 microversion: 2.1 time: 0.107201 May 19 12:28:25.038973 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 263/560] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:24 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:25.058456 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-74de3808-bdf5-4489-ba90-9d324258e8f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:25.066706 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-74de3808-bdf5-4489-ba90-9d324258e8f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.186225 May 19 12:28:25.067282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 298/561] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:24 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:25.106173 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-22da4336-0340-41e3-a74d-07848488d832 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:25.111610 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-22da4336-0340-41e3-a74d-07848488d832 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:25.120568 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22da4336-0340-41e3-a74d-07848488d832 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:25.123229 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22da4336-0340-41e3-a74d-07848488d832 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:25.124557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22da4336-0340-41e3-a74d-07848488d832 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:25.125072 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22da4336-0340-41e3-a74d-07848488d832 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:25.287684 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-22da4336-0340-41e3-a74d-07848488d832 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:25.296572 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-22da4336-0340-41e3-a74d-07848488d832 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:25.298102 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-22da4336-0340-41e3-a74d-07848488d832 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:25.299346 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-22da4336-0340-41e3-a74d-07848488d832 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1744 microversion: 2.20 time: 0.200676 May 19 12:28:25.299898 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 264/562] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:25 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1744 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:25.300920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-535d041d-5d75-47de-885c-878f59c8a802 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:25.301528 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-535d041d-5d75-47de-885c-878f59c8a802 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:25.307973 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-535d041d-5d75-47de-885c-878f59c8a802 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:25.308415 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-535d041d-5d75-47de-885c-878f59c8a802 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:25.309187 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-535d041d-5d75-47de-885c-878f59c8a802 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:25.309618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-535d041d-5d75-47de-885c-878f59c8a802 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:25.442939 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-535d041d-5d75-47de-885c-878f59c8a802 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:25.451275 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-535d041d-5d75-47de-885c-878f59c8a802 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1314 microversion: 2.1 time: 0.154229 May 19 12:28:25.451852 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 299/563] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:25 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:26.058345 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-36f9694c-6925-4271-8017-579725504407 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:26.059031 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-36f9694c-6925-4271-8017-579725504407 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:26.065553 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-36f9694c-6925-4271-8017-579725504407 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:26.065994 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-36f9694c-6925-4271-8017-579725504407 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:26.066791 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-36f9694c-6925-4271-8017-579725504407 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:26.067219 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-36f9694c-6925-4271-8017-579725504407 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:26.083636 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6432590e-8850-439c-a62e-4a322bbd636a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:26.085187 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6432590e-8850-439c-a62e-4a322bbd636a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:26.092079 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6432590e-8850-439c-a62e-4a322bbd636a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:26.092597 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6432590e-8850-439c-a62e-4a322bbd636a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:26.093245 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6432590e-8850-439c-a62e-4a322bbd636a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:26.094268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6432590e-8850-439c-a62e-4a322bbd636a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:26.146271 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-36f9694c-6925-4271-8017-579725504407 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:26.161238 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-36f9694c-6925-4271-8017-579725504407 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1301 microversion: 2.1 time: 0.102959 May 19 12:28:26.166456 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 265/564] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:26 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:26.319801 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c2f80195-69db-49b1-97df-fb84d36fbd73 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:26.320409 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c2f80195-69db-49b1-97df-fb84d36fbd73 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:26.328258 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c2f80195-69db-49b1-97df-fb84d36fbd73 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:26.329164 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c2f80195-69db-49b1-97df-fb84d36fbd73 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:26.329454 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c2f80195-69db-49b1-97df-fb84d36fbd73 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:26.330263 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c2f80195-69db-49b1-97df-fb84d36fbd73 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:26.571189 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6432590e-8850-439c-a62e-4a322bbd636a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:26.588266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c2f80195-69db-49b1-97df-fb84d36fbd73 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:26.599934 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c2f80195-69db-49b1-97df-fb84d36fbd73 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:26.606129 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6432590e-8850-439c-a62e-4a322bbd636a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1721 microversion: 2.1 time: 0.526128 May 19 12:28:26.606744 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 300/565] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:26 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1721 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:26.611344 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e5dc8cdc-e0da-4349-b590-d7907650da0f tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:26.611980 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e5dc8cdc-e0da-4349-b590-d7907650da0f tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:26.615655 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c2f80195-69db-49b1-97df-fb84d36fbd73 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:26.616891 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c2f80195-69db-49b1-97df-fb84d36fbd73 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.303121 May 19 12:28:26.634563 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 266/566] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:26 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:26.634822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e5dc8cdc-e0da-4349-b590-d7907650da0f tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:26.634822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e5dc8cdc-e0da-4349-b590-d7907650da0f tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:26.634822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e5dc8cdc-e0da-4349-b590-d7907650da0f tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:26.634822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e5dc8cdc-e0da-4349-b590-d7907650da0f tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:26.782749 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e5dc8cdc-e0da-4349-b590-d7907650da0f tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:26.798210 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e5dc8cdc-e0da-4349-b590-d7907650da0f tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1464 microversion: 2.1 time: 0.190350 May 19 12:28:26.799568 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 301/567] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:26 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1464 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:26.859705 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-eecf6658-bc90-47d4-8b7e-81f53b5f4d36 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:26.860200 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-eecf6658-bc90-47d4-8b7e-81f53b5f4d36 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:26.867353 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eecf6658-bc90-47d4-8b7e-81f53b5f4d36 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:26.868114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eecf6658-bc90-47d4-8b7e-81f53b5f4d36 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:26.868984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eecf6658-bc90-47d4-8b7e-81f53b5f4d36 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:26.869481 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eecf6658-bc90-47d4-8b7e-81f53b5f4d36 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:26.902060 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-eecf6658-bc90-47d4-8b7e-81f53b5f4d36 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:28:27.191172 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-11db5d5c-0a3e-40e3-9d09-a7404d36fa53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:27.193556 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-11db5d5c-0a3e-40e3-9d09-a7404d36fa53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:27.227382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-11db5d5c-0a3e-40e3-9d09-a7404d36fa53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:27.227844 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-11db5d5c-0a3e-40e3-9d09-a7404d36fa53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:27.228645 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-11db5d5c-0a3e-40e3-9d09-a7404d36fa53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:27.230860 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-11db5d5c-0a3e-40e3-9d09-a7404d36fa53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:27.253073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:27.506149 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-11db5d5c-0a3e-40e3-9d09-a7404d36fa53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:27.506149 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-11db5d5c-0a3e-40e3-9d09-a7404d36fa53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1367 microversion: 2.1 time: 0.290596 May 19 12:28:27.506149 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 302/568] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:27 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:27.643729 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-950a7d86-8dbd-4a32-b8d6-6b2ae06e4f90 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:27.645712 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-950a7d86-8dbd-4a32-b8d6-6b2ae06e4f90 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:27.681201 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-950a7d86-8dbd-4a32-b8d6-6b2ae06e4f90 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:27.684848 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-950a7d86-8dbd-4a32-b8d6-6b2ae06e4f90 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:27.685799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-950a7d86-8dbd-4a32-b8d6-6b2ae06e4f90 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:27.689164 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-950a7d86-8dbd-4a32-b8d6-6b2ae06e4f90 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:27.796219 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-eecf6658-bc90-47d4-8b7e-81f53b5f4d36 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 204 len: 0 microversion: 2.1 time: 0.939979 May 19 12:28:27.797722 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 267/569] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:28:26 2022] DELETE /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 0 bytes in 944 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:28:27.806787 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-218b5381-0835-4402-9830-37ee4f0c9623 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:27.808759 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-218b5381-0835-4402-9830-37ee4f0c9623 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:27.816254 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-218b5381-0835-4402-9830-37ee4f0c9623 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:27.816700 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-218b5381-0835-4402-9830-37ee4f0c9623 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:27.817754 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-218b5381-0835-4402-9830-37ee4f0c9623 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:27.818529 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-218b5381-0835-4402-9830-37ee4f0c9623 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:27.908615 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-950a7d86-8dbd-4a32-b8d6-6b2ae06e4f90 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:27.923812 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-950a7d86-8dbd-4a32-b8d6-6b2ae06e4f90 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1698 microversion: 2.1 time: 0.288567 May 19 12:28:27.927567 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 303/570] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:27 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1698 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:27.957206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-590b7471-e094-40a6-9421-412e24702273 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:27.957206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-590b7471-e094-40a6-9421-412e24702273 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:27.983101 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-590b7471-e094-40a6-9421-412e24702273 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:27.988398 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-590b7471-e094-40a6-9421-412e24702273 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:27.989861 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-590b7471-e094-40a6-9421-412e24702273 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:27.991288 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-590b7471-e094-40a6-9421-412e24702273 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:28.020448 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-218b5381-0835-4402-9830-37ee4f0c9623 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:28.034047 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-218b5381-0835-4402-9830-37ee4f0c9623 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:28.036156 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-218b5381-0835-4402-9830-37ee4f0c9623 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:28.037410 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-218b5381-0835-4402-9830-37ee4f0c9623 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.237029 May 19 12:28:28.037946 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 268/571] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:27 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:28.043922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-695a5449-35ab-4cc7-81ce-f6633f41b84c tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:28.070047 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-695a5449-35ab-4cc7-81ce-f6633f41b84c tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:28.070047 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-695a5449-35ab-4cc7-81ce-f6633f41b84c tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:28.184549 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-695a5449-35ab-4cc7-81ce-f6633f41b84c tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Going to try to start instance {{(pid=118111) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 12:28:28.279942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-590b7471-e094-40a6-9421-412e24702273 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:28.295997 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-590b7471-e094-40a6-9421-412e24702273 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1470 microversion: 2.1 time: 0.366577 May 19 12:28:28.297163 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 304/572] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:27 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1470 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:28.463708 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-695a5449-35ab-4cc7-81ce-f6633f41b84c tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "POST /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/action" status: 202 len: 0 microversion: 2.1 time: 0.424231 May 19 12:28:28.467493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 269/573] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:28:28 2022] POST /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:28:28.472509 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f61fab67-4c6d-4a75-9ec8-41d7b36720f0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:28.473032 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f61fab67-4c6d-4a75-9ec8-41d7b36720f0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:28.486204 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-156b6c32-de05-48b9-8f9b-16a125f64587 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:28.486944 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-156b6c32-de05-48b9-8f9b-16a125f64587 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:28.491484 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f61fab67-4c6d-4a75-9ec8-41d7b36720f0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:28.491951 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f61fab67-4c6d-4a75-9ec8-41d7b36720f0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:28.493370 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f61fab67-4c6d-4a75-9ec8-41d7b36720f0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:28.493821 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f61fab67-4c6d-4a75-9ec8-41d7b36720f0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:28.504242 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-156b6c32-de05-48b9-8f9b-16a125f64587 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:28.507090 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-156b6c32-de05-48b9-8f9b-16a125f64587 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:28.507090 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-156b6c32-de05-48b9-8f9b-16a125f64587 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:28.520621 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-156b6c32-de05-48b9-8f9b-16a125f64587 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:28.828604 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f61fab67-4c6d-4a75-9ec8-41d7b36720f0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:28.837929 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-156b6c32-de05-48b9-8f9b-16a125f64587 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:28.849516 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-156b6c32-de05-48b9-8f9b-16a125f64587 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1367 microversion: 2.1 time: 0.369960 May 19 12:28:28.850188 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f61fab67-4c6d-4a75-9ec8-41d7b36720f0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1707 microversion: 2.1 time: 0.381441 May 19 12:28:28.850700 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 270/574] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:28 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:28.865351 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-9e5a4352-c94c-4585-b40e-a5bc78cd5b4f req-6029b15d-7265-42c6-a7c0-8de440cc4798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121221d9-cf95-4729-9331-c2696a743b0b", "tag": "bdc95f17-5855-4791-bcdb-d9206b642684"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:28.876685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-9e5a4352-c94c-4585-b40e-a5bc78cd5b4f req-6029b15d-7265-42c6-a7c0-8de440cc4798 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:28.877517 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-9e5a4352-c94c-4585-b40e-a5bc78cd5b4f req-6029b15d-7265-42c6-a7c0-8de440cc4798 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:28.879355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 305/575] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:28 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1707 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:28.911928 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-9e5a4352-c94c-4585-b40e-a5bc78cd5b4f req-6029b15d-7265-42c6-a7c0-8de440cc4798 service nova] Creating event network-changed:bdc95f17-5855-4791-bcdb-d9206b642684 for instance 121221d9-cf95-4729-9331-c2696a743b0b on hv-cinder-77819 May 19 12:28:28.931487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-9e5a4352-c94c-4585-b40e-a5bc78cd5b4f req-6029b15d-7265-42c6-a7c0-8de440cc4798 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069428 May 19 12:28:28.931487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 271/576] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:29.064860 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-145d02af-b4fc-4a51-a069-5047d1fe45b8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:29.066602 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-145d02af-b4fc-4a51-a069-5047d1fe45b8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:29.082230 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-145d02af-b4fc-4a51-a069-5047d1fe45b8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.089361 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-145d02af-b4fc-4a51-a069-5047d1fe45b8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.089361 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-145d02af-b4fc-4a51-a069-5047d1fe45b8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.089361 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-145d02af-b4fc-4a51-a069-5047d1fe45b8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.298502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-145d02af-b4fc-4a51-a069-5047d1fe45b8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:29.315125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-145d02af-b4fc-4a51-a069-5047d1fe45b8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:29.317899 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-145d02af-b4fc-4a51-a069-5047d1fe45b8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:29.320377 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-145d02af-b4fc-4a51-a069-5047d1fe45b8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.262166 May 19 12:28:29.321366 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 306/577] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:29 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:29.345561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c1ea24df-bd15-4fae-91df-d927b713c747 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:29.346389 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c1ea24df-bd15-4fae-91df-d927b713c747 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:29.368016 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c1ea24df-bd15-4fae-91df-d927b713c747 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.369444 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c1ea24df-bd15-4fae-91df-d927b713c747 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.373723 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c1ea24df-bd15-4fae-91df-d927b713c747 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.375438 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c1ea24df-bd15-4fae-91df-d927b713c747 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.589372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c1ea24df-bd15-4fae-91df-d927b713c747 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:29.597697 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c1ea24df-bd15-4fae-91df-d927b713c747 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1470 microversion: 2.1 time: 0.272892 May 19 12:28:29.602702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 272/578] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:29 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1470 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:29.871828 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1716d760-1731-4932-86a8-677538d11af8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:29.874302 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1716d760-1731-4932-86a8-677538d11af8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:29.879559 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5b4a51d5-bef0-46c8-880e-845e8555c350 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:29.880398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5b4a51d5-bef0-46c8-880e-845e8555c350 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:29.883247 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1716d760-1731-4932-86a8-677538d11af8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.883965 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1716d760-1731-4932-86a8-677538d11af8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.884702 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1716d760-1731-4932-86a8-677538d11af8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.885146 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1716d760-1731-4932-86a8-677538d11af8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.889708 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b4a51d5-bef0-46c8-880e-845e8555c350 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.890222 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b4a51d5-bef0-46c8-880e-845e8555c350 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:29.892018 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b4a51d5-bef0-46c8-880e-845e8555c350 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:29.894475 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b4a51d5-bef0-46c8-880e-845e8555c350 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:30.140642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5b4a51d5-bef0-46c8-880e-845e8555c350 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:30.160563 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5b4a51d5-bef0-46c8-880e-845e8555c350 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1707 microversion: 2.1 time: 0.285046 May 19 12:28:30.160780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1716d760-1731-4932-86a8-677538d11af8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:30.166458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 273/579] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:29 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1707 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:30.172547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1716d760-1731-4932-86a8-677538d11af8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1367 microversion: 2.1 time: 0.307617 May 19 12:28:30.185583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 307/580] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:29 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:30.352016 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-47089ad3-e7b9-4626-8d92-ad0e184455df tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:30.362164 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-47089ad3-e7b9-4626-8d92-ad0e184455df tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:30.368413 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-47089ad3-e7b9-4626-8d92-ad0e184455df tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:30.370383 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-47089ad3-e7b9-4626-8d92-ad0e184455df tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:30.381167 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-47089ad3-e7b9-4626-8d92-ad0e184455df tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:30.382364 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-47089ad3-e7b9-4626-8d92-ad0e184455df tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:30.638253 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d85423af-d22c-4729-80c0-6cebfee052a2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:30.640762 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d85423af-d22c-4729-80c0-6cebfee052a2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:30.670639 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d85423af-d22c-4729-80c0-6cebfee052a2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:30.671323 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d85423af-d22c-4729-80c0-6cebfee052a2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:30.672311 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d85423af-d22c-4729-80c0-6cebfee052a2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:30.672793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d85423af-d22c-4729-80c0-6cebfee052a2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:30.681255 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-47089ad3-e7b9-4626-8d92-ad0e184455df tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:30.712375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-47089ad3-e7b9-4626-8d92-ad0e184455df tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:30.716293 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-47089ad3-e7b9-4626-8d92-ad0e184455df tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:30.718361 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-47089ad3-e7b9-4626-8d92-ad0e184455df tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.371884 May 19 12:28:30.719375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 274/581] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:30 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:30.835918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d85423af-d22c-4729-80c0-6cebfee052a2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:30.843926 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d85423af-d22c-4729-80c0-6cebfee052a2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1470 microversion: 2.1 time: 0.227525 May 19 12:28:30.844499 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 308/582] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:30 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1470 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:31.188911 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e424c121-fcc1-42f7-9bde-404963dc47fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:31.188911 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e424c121-fcc1-42f7-9bde-404963dc47fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:31.193229 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e24a6aca-365e-4bd9-a770-9632e4df0328 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:31.193845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e24a6aca-365e-4bd9-a770-9632e4df0328 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:31.194320 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e424c121-fcc1-42f7-9bde-404963dc47fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:31.194820 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e424c121-fcc1-42f7-9bde-404963dc47fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:31.196224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:31.196911 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e424c121-fcc1-42f7-9bde-404963dc47fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:31.197360 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e424c121-fcc1-42f7-9bde-404963dc47fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:31.203773 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e24a6aca-365e-4bd9-a770-9632e4df0328 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:31.204227 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e24a6aca-365e-4bd9-a770-9632e4df0328 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:31.205106 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e24a6aca-365e-4bd9-a770-9632e4df0328 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:31.210598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e24a6aca-365e-4bd9-a770-9632e4df0328 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:31.486022 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e24a6aca-365e-4bd9-a770-9632e4df0328 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:31.497215 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e24a6aca-365e-4bd9-a770-9632e4df0328 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1367 microversion: 2.1 time: 0.307703 May 19 12:28:31.503411 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 309/583] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:31 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:31.653927 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e424c121-fcc1-42f7-9bde-404963dc47fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:31.670572 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e424c121-fcc1-42f7-9bde-404963dc47fc tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1707 microversion: 2.1 time: 0.493650 May 19 12:28:31.673733 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 275/584] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:31 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1707 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:31.739648 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9b1324f5-8e46-444b-8a61-6acf6ece9a37 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:31.740857 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9b1324f5-8e46-444b-8a61-6acf6ece9a37 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:31.742844 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=8 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:31.752125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9b1324f5-8e46-444b-8a61-6acf6ece9a37 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:31.755592 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9b1324f5-8e46-444b-8a61-6acf6ece9a37 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:31.757104 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9b1324f5-8e46-444b-8a61-6acf6ece9a37 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:31.759886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9b1324f5-8e46-444b-8a61-6acf6ece9a37 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:31.865845 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c4253134-9fea-459b-980b-d101a0700b47 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:31.866574 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c4253134-9fea-459b-980b-d101a0700b47 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:31.883629 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4253134-9fea-459b-980b-d101a0700b47 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:31.887111 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4253134-9fea-459b-980b-d101a0700b47 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:31.892325 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4253134-9fea-459b-980b-d101a0700b47 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:31.893252 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4253134-9fea-459b-980b-d101a0700b47 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.155460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c4253134-9fea-459b-980b-d101a0700b47 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:32.158701 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:32.165205 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c4253134-9fea-459b-980b-d101a0700b47 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1428 microversion: 2.1 time: 0.305144 May 19 12:28:32.165784 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 276/585] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:31 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1428 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:32.177602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-a1c29b2e-1f6b-4531-81ee-746901ae566c req-b41f76a9-be24-467f-af4a-edf90d0f259f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2eeef31-7890-43bf-83fe-7674f49f53a0", "name": "network-vif-deleted", "tag": "452993dd-560e-4269-adb0-b9a0b4d301d3"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:32.189140 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-a1c29b2e-1f6b-4531-81ee-746901ae566c req-b41f76a9-be24-467f-af4a-edf90d0f259f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:32.195782 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-a1c29b2e-1f6b-4531-81ee-746901ae566c req-b41f76a9-be24-467f-af4a-edf90d0f259f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.220519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-a1c29b2e-1f6b-4531-81ee-746901ae566c req-b41f76a9-be24-467f-af4a-edf90d0f259f service nova] Creating event network-vif-deleted:452993dd-560e-4269-adb0-b9a0b4d301d3 for instance d2eeef31-7890-43bf-83fe-7674f49f53a0 on hv-cinder-77819 May 19 12:28:32.230869 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-a1c29b2e-1f6b-4531-81ee-746901ae566c req-b41f76a9-be24-467f-af4a-edf90d0f259f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058887 May 19 12:28:32.235803 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9b1324f5-8e46-444b-8a61-6acf6ece9a37 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:32.240222 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 277/586] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:32.246770 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7df300ba-bc1f-440d-becb-83c152fe2715 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:32.247491 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7df300ba-bc1f-440d-becb-83c152fe2715 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:32.255838 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7df300ba-bc1f-440d-becb-83c152fe2715 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:32.258242 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7df300ba-bc1f-440d-becb-83c152fe2715 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.258242 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7df300ba-bc1f-440d-becb-83c152fe2715 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:32.258242 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7df300ba-bc1f-440d-becb-83c152fe2715 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.261336 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9b1324f5-8e46-444b-8a61-6acf6ece9a37 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:32.263797 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9b1324f5-8e46-444b-8a61-6acf6ece9a37 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:32.265214 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9b1324f5-8e46-444b-8a61-6acf6ece9a37 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.530515 May 19 12:28:32.276854 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 310/587] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:31 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:32.423565 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7df300ba-bc1f-440d-becb-83c152fe2715 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:32.432171 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7df300ba-bc1f-440d-becb-83c152fe2715 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1594 microversion: 2.1 time: 0.190660 May 19 12:28:32.433083 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 278/588] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:32 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1594 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:32.519698 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a24d2031-e139-4def-bc9e-f60137592366 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:32.520219 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a24d2031-e139-4def-bc9e-f60137592366 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:32.527129 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a24d2031-e139-4def-bc9e-f60137592366 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:32.527939 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a24d2031-e139-4def-bc9e-f60137592366 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.528734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a24d2031-e139-4def-bc9e-f60137592366 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:32.529176 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a24d2031-e139-4def-bc9e-f60137592366 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.533398 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:32.701758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e5c295ef-9c6d-4576-92e5-31b62dbce702 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:32.702612 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e5c295ef-9c6d-4576-92e5-31b62dbce702 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:32.710980 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e5c295ef-9c6d-4576-92e5-31b62dbce702 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:32.711769 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e5c295ef-9c6d-4576-92e5-31b62dbce702 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.713169 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e5c295ef-9c6d-4576-92e5-31b62dbce702 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:32.714939 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e5c295ef-9c6d-4576-92e5-31b62dbce702 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:32.735492 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a24d2031-e139-4def-bc9e-f60137592366 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:32.752107 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a24d2031-e139-4def-bc9e-f60137592366 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1367 microversion: 2.1 time: 0.236081 May 19 12:28:32.754518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 311/589] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:32 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:32.932868 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e5c295ef-9c6d-4576-92e5-31b62dbce702 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:32.943394 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e5c295ef-9c6d-4576-92e5-31b62dbce702 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1707 microversion: 2.1 time: 0.246024 May 19 12:28:32.944687 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 279/590] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:32 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1707 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:33.187741 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3cc86edf-2745-42a3-9b7a-0113bde71cda tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:33.190223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3cc86edf-2745-42a3-9b7a-0113bde71cda tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:33.213193 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cc86edf-2745-42a3-9b7a-0113bde71cda tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:33.214901 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cc86edf-2745-42a3-9b7a-0113bde71cda tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:33.217692 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cc86edf-2745-42a3-9b7a-0113bde71cda tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:33.221031 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cc86edf-2745-42a3-9b7a-0113bde71cda tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:33.287390 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c1288fa0-59a3-4a07-8269-8cb43843cb94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:33.289270 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c1288fa0-59a3-4a07-8269-8cb43843cb94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:33.298251 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c1288fa0-59a3-4a07-8269-8cb43843cb94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:33.298820 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c1288fa0-59a3-4a07-8269-8cb43843cb94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:33.299679 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c1288fa0-59a3-4a07-8269-8cb43843cb94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:33.300178 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c1288fa0-59a3-4a07-8269-8cb43843cb94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:33.353674 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3cc86edf-2745-42a3-9b7a-0113bde71cda tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:33.364459 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3cc86edf-2745-42a3-9b7a-0113bde71cda tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1428 microversion: 2.1 time: 0.184297 May 19 12:28:33.375389 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 312/591] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:33 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1428 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:33.475522 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c1288fa0-59a3-4a07-8269-8cb43843cb94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:33.485991 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c1288fa0-59a3-4a07-8269-8cb43843cb94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:33.487935 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c1288fa0-59a3-4a07-8269-8cb43843cb94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:33.489120 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c1288fa0-59a3-4a07-8269-8cb43843cb94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.207247 May 19 12:28:33.489690 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 280/592] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:33 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:33.775539 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-35ad2627-ce6a-4ee2-b01c-6612b7dd9d6f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:33.777312 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-35ad2627-ce6a-4ee2-b01c-6612b7dd9d6f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:33.784249 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-35ad2627-ce6a-4ee2-b01c-6612b7dd9d6f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:33.784704 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-35ad2627-ce6a-4ee2-b01c-6612b7dd9d6f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:33.785493 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-35ad2627-ce6a-4ee2-b01c-6612b7dd9d6f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:33.785932 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-35ad2627-ce6a-4ee2-b01c-6612b7dd9d6f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:33.962002 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d3871632-2264-4d75-b9a8-1a9ce166e6db tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:33.964037 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d3871632-2264-4d75-b9a8-1a9ce166e6db tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:33.973214 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3871632-2264-4d75-b9a8-1a9ce166e6db tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:33.974055 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3871632-2264-4d75-b9a8-1a9ce166e6db tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:33.975095 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3871632-2264-4d75-b9a8-1a9ce166e6db tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:33.975745 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3871632-2264-4d75-b9a8-1a9ce166e6db tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:34.009373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-35ad2627-ce6a-4ee2-b01c-6612b7dd9d6f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:34.018290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-35ad2627-ce6a-4ee2-b01c-6612b7dd9d6f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1367 microversion: 2.1 time: 0.246972 May 19 12:28:34.020496 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 313/593] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:33 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:34.173870 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d3871632-2264-4d75-b9a8-1a9ce166e6db tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:34.185783 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d3871632-2264-4d75-b9a8-1a9ce166e6db tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1707 microversion: 2.1 time: 0.226340 May 19 12:28:34.186585 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 281/594] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:33 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1707 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:34.382532 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-70e3fc32-016b-43b0-a601-2f3ef1e63ca4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:34.383140 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-70e3fc32-016b-43b0-a601-2f3ef1e63ca4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:34.390451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-70e3fc32-016b-43b0-a601-2f3ef1e63ca4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:34.390907 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-70e3fc32-016b-43b0-a601-2f3ef1e63ca4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:34.391699 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-70e3fc32-016b-43b0-a601-2f3ef1e63ca4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:34.392138 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-70e3fc32-016b-43b0-a601-2f3ef1e63ca4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:34.477095 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-70e3fc32-016b-43b0-a601-2f3ef1e63ca4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:34.488672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-70e3fc32-016b-43b0-a601-2f3ef1e63ca4 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1428 microversion: 2.1 time: 0.109630 May 19 12:28:34.489446 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 314/595] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:34 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1428 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:34.507922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5b76af99-439a-4b78-82be-162d2135efb7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:34.513922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5b76af99-439a-4b78-82be-162d2135efb7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:34.515469 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b76af99-439a-4b78-82be-162d2135efb7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:34.516106 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b76af99-439a-4b78-82be-162d2135efb7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:34.517104 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b76af99-439a-4b78-82be-162d2135efb7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:34.517547 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b76af99-439a-4b78-82be-162d2135efb7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:34.740804 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5b76af99-439a-4b78-82be-162d2135efb7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:34.751519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5b76af99-439a-4b78-82be-162d2135efb7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:34.753919 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5b76af99-439a-4b78-82be-162d2135efb7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:34.755899 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5b76af99-439a-4b78-82be-162d2135efb7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.251595 May 19 12:28:34.756899 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 282/596] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:34 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:35.040467 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-77721f82-d6c7-4491-b8ab-286094ba3828 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:35.041225 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-77721f82-d6c7-4491-b8ab-286094ba3828 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:35.048095 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-77721f82-d6c7-4491-b8ab-286094ba3828 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.049281 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-77721f82-d6c7-4491-b8ab-286094ba3828 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.050837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-77721f82-d6c7-4491-b8ab-286094ba3828 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.051521 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-77721f82-d6c7-4491-b8ab-286094ba3828 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.206777 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0254ebc7-d651-406d-a7e6-85535765bff4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:35.207968 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0254ebc7-d651-406d-a7e6-85535765bff4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:35.218826 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0254ebc7-d651-406d-a7e6-85535765bff4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.218826 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0254ebc7-d651-406d-a7e6-85535765bff4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.218826 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0254ebc7-d651-406d-a7e6-85535765bff4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.218826 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0254ebc7-d651-406d-a7e6-85535765bff4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.232964 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-77721f82-d6c7-4491-b8ab-286094ba3828 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:35.241886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-77721f82-d6c7-4491-b8ab-286094ba3828 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1367 microversion: 2.1 time: 0.208452 May 19 12:28:35.248808 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 315/597] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:35 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:35.363397 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0254ebc7-d651-406d-a7e6-85535765bff4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:35.372598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0254ebc7-d651-406d-a7e6-85535765bff4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1707 microversion: 2.1 time: 0.171329 May 19 12:28:35.373182 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 283/598] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:35 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1707 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:35.508321 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-11279f56-1a2f-44c0-b023-eb30220d8a4b tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:35.508999 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-11279f56-1a2f-44c0-b023-eb30220d8a4b tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:35.515680 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-11279f56-1a2f-44c0-b023-eb30220d8a4b tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.516166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-11279f56-1a2f-44c0-b023-eb30220d8a4b tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.516930 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-11279f56-1a2f-44c0-b023-eb30220d8a4b tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.517370 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-11279f56-1a2f-44c0-b023-eb30220d8a4b tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.590305 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-11279f56-1a2f-44c0-b023-eb30220d8a4b tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:35.597877 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-11279f56-1a2f-44c0-b023-eb30220d8a4b tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1299 microversion: 2.1 time: 0.093601 May 19 12:28:35.598459 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 316/599] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:35 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:35.776363 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c95fb189-4a59-435c-8240-bf7d27e51c4e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:35.777040 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c95fb189-4a59-435c-8240-bf7d27e51c4e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:35.784388 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c95fb189-4a59-435c-8240-bf7d27e51c4e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.784835 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c95fb189-4a59-435c-8240-bf7d27e51c4e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.785941 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c95fb189-4a59-435c-8240-bf7d27e51c4e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:35.786965 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c95fb189-4a59-435c-8240-bf7d27e51c4e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:35.931575 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c95fb189-4a59-435c-8240-bf7d27e51c4e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:35.939997 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c95fb189-4a59-435c-8240-bf7d27e51c4e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:35.941501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c95fb189-4a59-435c-8240-bf7d27e51c4e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:35.942712 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c95fb189-4a59-435c-8240-bf7d27e51c4e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.170488 May 19 12:28:35.943290 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 284/600] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:35 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:36.000066 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-84706965-cbed-47b6-84e0-dc60ba6d7362 req-c4bbe4df-5573-47df-9ff6-d458e1256f03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70659f4e-c927-47dc-a23a-abd0db258731", "tag": "d7221580-bd77-42eb-a222-b1dd8a491c4c"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:36.009444 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-84706965-cbed-47b6-84e0-dc60ba6d7362 req-c4bbe4df-5573-47df-9ff6-d458e1256f03 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:36.009895 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-84706965-cbed-47b6-84e0-dc60ba6d7362 req-c4bbe4df-5573-47df-9ff6-d458e1256f03 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:36.022539 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-84706965-cbed-47b6-84e0-dc60ba6d7362 req-c4bbe4df-5573-47df-9ff6-d458e1256f03 service nova] Creating event network-changed:d7221580-bd77-42eb-a222-b1dd8a491c4c for instance 70659f4e-c927-47dc-a23a-abd0db258731 on hv-cinder-77819 May 19 12:28:36.029085 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-84706965-cbed-47b6-84e0-dc60ba6d7362 req-c4bbe4df-5573-47df-9ff6-d458e1256f03 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032303 May 19 12:28:36.030052 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 317/601] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:36.266287 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-03ae45c1-4743-4c5b-a161-2d00c65dab9b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:36.271351 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-03ae45c1-4743-4c5b-a161-2d00c65dab9b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:36.336045 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-03ae45c1-4743-4c5b-a161-2d00c65dab9b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:36.347367 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-03ae45c1-4743-4c5b-a161-2d00c65dab9b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:36.351558 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-03ae45c1-4743-4c5b-a161-2d00c65dab9b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:36.353444 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-03ae45c1-4743-4c5b-a161-2d00c65dab9b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:36.403330 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0ec3dc31-61cc-4f6c-8349-76bf3b971484 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:36.406018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0ec3dc31-61cc-4f6c-8349-76bf3b971484 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:36.441634 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ec3dc31-61cc-4f6c-8349-76bf3b971484 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:36.442947 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ec3dc31-61cc-4f6c-8349-76bf3b971484 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:36.446716 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ec3dc31-61cc-4f6c-8349-76bf3b971484 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:36.450231 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ec3dc31-61cc-4f6c-8349-76bf3b971484 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:36.848075 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-03ae45c1-4743-4c5b-a161-2d00c65dab9b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:36.857238 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-03ae45c1-4743-4c5b-a161-2d00c65dab9b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1367 microversion: 2.1 time: 0.600960 May 19 12:28:36.867213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 285/602] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:36 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1367 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:36.873026 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-07b4111f-a58b-45f3-a16c-a37da0b352d2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:36.874213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-07b4111f-a58b-45f3-a16c-a37da0b352d2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:36.888365 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07b4111f-a58b-45f3-a16c-a37da0b352d2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:36.891158 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07b4111f-a58b-45f3-a16c-a37da0b352d2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:36.892227 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07b4111f-a58b-45f3-a16c-a37da0b352d2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:36.892838 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07b4111f-a58b-45f3-a16c-a37da0b352d2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:36.965597 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07b4111f-a58b-45f3-a16c-a37da0b352d2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:36.968440 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-07b4111f-a58b-45f3-a16c-a37da0b352d2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:36.969241 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-07b4111f-a58b-45f3-a16c-a37da0b352d2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lazy-loading 'fault' on Instance uuid d2eeef31-7890-43bf-83fe-7674f49f53a0 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:28:37.156293 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-07b4111f-a58b-45f3-a16c-a37da0b352d2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc67af013a0c4299acd7f2b4de73f7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566bbc906fb54ffab4964acccd8e68d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:37.165180 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0ec3dc31-61cc-4f6c-8349-76bf3b971484 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:37.170428 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-07b4111f-a58b-45f3-a16c-a37da0b352d2 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 200 len: 1304 microversion: 2.1 time: 0.297706 May 19 12:28:37.171127 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 286/603] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:36 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 1304 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:37.178356 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e9d8fcb0-da4c-40ad-af88-7174dfa1b537 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:37.179032 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e9d8fcb0-da4c-40ad-af88-7174dfa1b537 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:37.201390 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9d8fcb0-da4c-40ad-af88-7174dfa1b537 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:37.201832 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9d8fcb0-da4c-40ad-af88-7174dfa1b537 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:37.203327 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9d8fcb0-da4c-40ad-af88-7174dfa1b537 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:37.203807 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9d8fcb0-da4c-40ad-af88-7174dfa1b537 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:37.209300 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0ec3dc31-61cc-4f6c-8349-76bf3b971484 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1707 microversion: 2.1 time: 0.821394 May 19 12:28:37.211286 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 318/604] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:36 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1707 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:37.516498 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e9d8fcb0-da4c-40ad-af88-7174dfa1b537 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:37.536965 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e9d8fcb0-da4c-40ad-af88-7174dfa1b537 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:37.539692 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e9d8fcb0-da4c-40ad-af88-7174dfa1b537 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:37.543556 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e9d8fcb0-da4c-40ad-af88-7174dfa1b537 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.371116 May 19 12:28:37.545568 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 287/605] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:37 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:37.885563 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9a2b1128-8b40-4f30-9851-271504f8d307 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:37.887056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9a2b1128-8b40-4f30-9851-271504f8d307 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:37.896064 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9a2b1128-8b40-4f30-9851-271504f8d307 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:37.896779 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9a2b1128-8b40-4f30-9851-271504f8d307 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:37.897979 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9a2b1128-8b40-4f30-9851-271504f8d307 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:37.898622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9a2b1128-8b40-4f30-9851-271504f8d307 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:38.145085 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9a2b1128-8b40-4f30-9851-271504f8d307 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:38.152711 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9a2b1128-8b40-4f30-9851-271504f8d307 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1367 microversion: 2.1 time: 0.271038 May 19 12:28:38.163136 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 319/606] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:37 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1367 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:38.188720 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7b4f0e8b-6bec-49be-ac85-f500b5a16899 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:38.189855 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7b4f0e8b-6bec-49be-ac85-f500b5a16899 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] [instance: d2eeef31-7890-43bf-83fe-7674f49f53a0] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:38.198992 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b4f0e8b-6bec-49be-ac85-f500b5a16899 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:38.199829 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b4f0e8b-6bec-49be-ac85-f500b5a16899 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:38.200876 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b4f0e8b-6bec-49be-ac85-f500b5a16899 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:38.201535 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b4f0e8b-6bec-49be-ac85-f500b5a16899 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:38.224367 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-7b4f0e8b-6bec-49be-ac85-f500b5a16899 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] HTTP exception thrown: Instance d2eeef31-7890-43bf-83fe-7674f49f53a0 could not be found. May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7b4f0e8b-6bec-49be-ac85-f500b5a16899 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Request method failure captured: May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 HTTP/1.1 May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjfOsLAvIHK0UeSzrB3omYgBcAKV6PWPf0XBBQtQRY6av6hUBH2B9MmardSCYWtgZQe8DXruw6n9q4dJkG9UPZjAzdIoxCkPg-RNR3S-AmJfhc4Icz1j1ijTslJqQlDqpvMTMJ6-WWnlI2kMV3zg3FtD1daXtriEy45trlUwnjyug44 May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 566bbc906fb54ffab4964acccd8e68d8 May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesNegativeTest-1289234380 May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:28:38.228439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:28:38.231512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/566bbc906fb54ffab4964acccd8e68d8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/566bbc906fb54ffab4964acccd8e68d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/566bbc906fb54ffab4964acccd8e68d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_566bbc906fb54ffab4964acccd8e68d8", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:28:38.231512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesNegativeTest-1289234380 May 19 12:28:38.231512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 566bbc906fb54ffab4964acccd8e68d8 May 19 12:28:38.231512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesNegativeTest-1289234380 May 19 12:28:38.231512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesNegativeTest-1289234380-project May 19 12:28:38.231512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:28:38.231512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:28:38.231512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: cc67af013a0c4299acd7f2b4de73f7fa May 19 12:28:38.231512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesNegativeTest-1289234380-project May 19 12:28:38.231512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:28:38.231512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance d2eeef31-7890-43bf-83fe-7674f49f53a0 could not be found. May 19 12:28:38.231512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': 'd2eeef31-7890-43bf-83fe-7674f49f53a0'} May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2eeef31-7890-43bf-83fe-7674f49f53a0 could not be found. May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:28:38.232503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2eeef31-7890-43bf-83fe-7674f49f53a0 could not be found. May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2eeef31-7890-43bf-83fe-7674f49f53a0 could not be found. May 19 12:28:38.237372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:28:38.242539 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c6dbfe54-a55b-449d-a464-44d8754fffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:38.242539 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c6dbfe54-a55b-449d-a464-44d8754fffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:38.244172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7b4f0e8b-6bec-49be-ac85-f500b5a16899 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] Returning 404 to user: Instance d2eeef31-7890-43bf-83fe-7674f49f53a0 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:28:38.246544 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7b4f0e8b-6bec-49be-ac85-f500b5a16899 tempest-VolumesNegativeTest-1289234380 tempest-VolumesNegativeTest-1289234380-project] 10.222.0.57 "GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0" status: 404 len: 111 microversion: 2.1 time: 0.060346 May 19 12:28:38.251975 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 288/607] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:38 2022] GET /compute/v2.1/servers/d2eeef31-7890-43bf-83fe-7674f49f53a0 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:28:38.288042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c6dbfe54-a55b-449d-a464-44d8754fffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:38.288898 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c6dbfe54-a55b-449d-a464-44d8754fffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:38.290778 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c6dbfe54-a55b-449d-a464-44d8754fffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:38.291872 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c6dbfe54-a55b-449d-a464-44d8754fffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:38.566006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6afba707-d316-4506-bbca-be63507d2632 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:38.566767 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6afba707-d316-4506-bbca-be63507d2632 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:38.574296 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c6dbfe54-a55b-449d-a464-44d8754fffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:38.578197 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6afba707-d316-4506-bbca-be63507d2632 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:38.583549 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6afba707-d316-4506-bbca-be63507d2632 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:38.584283 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c6dbfe54-a55b-449d-a464-44d8754fffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1711 microversion: 2.1 time: 0.352703 May 19 12:28:38.585024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6afba707-d316-4506-bbca-be63507d2632 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:38.585308 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6afba707-d316-4506-bbca-be63507d2632 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:38.586796 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 320/608] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:38 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1711 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:38.808690 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6afba707-d316-4506-bbca-be63507d2632 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:38.828944 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6afba707-d316-4506-bbca-be63507d2632 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:38.832661 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6afba707-d316-4506-bbca-be63507d2632 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:38.835124 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6afba707-d316-4506-bbca-be63507d2632 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.273175 May 19 12:28:38.836304 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 289/609] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:38 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:39.176209 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-67ad8130-d14f-4df4-9e5e-053b1ff46e0b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:39.178931 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-67ad8130-d14f-4df4-9e5e-053b1ff46e0b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:39.204762 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-67ad8130-d14f-4df4-9e5e-053b1ff46e0b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:39.205804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-67ad8130-d14f-4df4-9e5e-053b1ff46e0b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:39.207785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-67ad8130-d14f-4df4-9e5e-053b1ff46e0b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:39.208386 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-67ad8130-d14f-4df4-9e5e-053b1ff46e0b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:39.443855 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-67ad8130-d14f-4df4-9e5e-053b1ff46e0b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:39.462856 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-67ad8130-d14f-4df4-9e5e-053b1ff46e0b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1367 microversion: 2.1 time: 0.295029 May 19 12:28:39.474737 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 321/610] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:39 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:39.542810 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-ddd6cb04-e810-4efd-858e-0a7269285ad7 req-eefe7fbb-42f2-400e-be54-2c819d5f9f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121221d9-cf95-4729-9331-c2696a743b0b", "name": "network-vif-plugged", "status": "completed", "tag": "bdc95f17-5855-4791-bcdb-d9206b642684"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:39.560615 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ddd6cb04-e810-4efd-858e-0a7269285ad7 req-eefe7fbb-42f2-400e-be54-2c819d5f9f8c service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:39.565052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ddd6cb04-e810-4efd-858e-0a7269285ad7 req-eefe7fbb-42f2-400e-be54-2c819d5f9f8c service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:39.586207 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-ddd6cb04-e810-4efd-858e-0a7269285ad7 req-eefe7fbb-42f2-400e-be54-2c819d5f9f8c service nova] Creating event network-vif-plugged:bdc95f17-5855-4791-bcdb-d9206b642684 for instance 121221d9-cf95-4729-9331-c2696a743b0b on hv-cinder-77819 May 19 12:28:39.593967 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-ddd6cb04-e810-4efd-858e-0a7269285ad7 req-eefe7fbb-42f2-400e-be54-2c819d5f9f8c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055883 May 19 12:28:39.595606 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 290/611] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:39.892300 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fe230d80-fcc1-4a2b-8fbc-7fa5a81fd087 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:39.893000 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fe230d80-fcc1-4a2b-8fbc-7fa5a81fd087 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:39.901661 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe230d80-fcc1-4a2b-8fbc-7fa5a81fd087 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:39.905848 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe230d80-fcc1-4a2b-8fbc-7fa5a81fd087 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:39.905848 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe230d80-fcc1-4a2b-8fbc-7fa5a81fd087 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:39.905848 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe230d80-fcc1-4a2b-8fbc-7fa5a81fd087 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:40.178018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fe230d80-fcc1-4a2b-8fbc-7fa5a81fd087 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:40.178018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fe230d80-fcc1-4a2b-8fbc-7fa5a81fd087 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:40.178833 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fe230d80-fcc1-4a2b-8fbc-7fa5a81fd087 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:40.178833 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fe230d80-fcc1-4a2b-8fbc-7fa5a81fd087 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.218625 May 19 12:28:40.178833 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 322/612] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:39 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:40.482667 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a21f0fd9-068e-4ea8-a0a1-0dade3ccdf98 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:40.483377 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a21f0fd9-068e-4ea8-a0a1-0dade3ccdf98 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:40.490250 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a21f0fd9-068e-4ea8-a0a1-0dade3ccdf98 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:40.490723 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a21f0fd9-068e-4ea8-a0a1-0dade3ccdf98 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:40.491498 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a21f0fd9-068e-4ea8-a0a1-0dade3ccdf98 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:40.492039 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a21f0fd9-068e-4ea8-a0a1-0dade3ccdf98 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:40.654545 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a21f0fd9-068e-4ea8-a0a1-0dade3ccdf98 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:40.663024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a21f0fd9-068e-4ea8-a0a1-0dade3ccdf98 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1367 microversion: 2.1 time: 0.185092 May 19 12:28:40.663608 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 291/613] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:40 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:41.100925 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-73b11eec-7e5a-46af-a980-5d2abbd5991a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:41.101775 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-73b11eec-7e5a-46af-a980-5d2abbd5991a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:41.112739 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-73b11eec-7e5a-46af-a980-5d2abbd5991a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:41.113207 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-73b11eec-7e5a-46af-a980-5d2abbd5991a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:41.114807 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-73b11eec-7e5a-46af-a980-5d2abbd5991a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:41.115253 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-73b11eec-7e5a-46af-a980-5d2abbd5991a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:41.365447 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-73b11eec-7e5a-46af-a980-5d2abbd5991a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:41.375604 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-73b11eec-7e5a-46af-a980-5d2abbd5991a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:41.377113 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-73b11eec-7e5a-46af-a980-5d2abbd5991a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:41.378967 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-73b11eec-7e5a-46af-a980-5d2abbd5991a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.282358 May 19 12:28:41.379765 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 323/614] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:41 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:41.438172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9917244e-1387-4d71-b3fc-8076348e5018 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1576727543"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:41.443066 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9917244e-1387-4d71-b3fc-8076348e5018 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:41.455556 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9917244e-1387-4d71-b3fc-8076348e5018 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:41.456583 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9917244e-1387-4d71-b3fc-8076348e5018 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:41.458809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9917244e-1387-4d71-b3fc-8076348e5018 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:41.460170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9917244e-1387-4d71-b3fc-8076348e5018 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:41.660086 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.network.security_group_api [None req-9917244e-1387-4d71-b3fc-8076348e5018 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Adding security group f3c5ed84-35fd-4b71-a298-bf783933d458 to port d7221580-bd77-42eb-a222-b1dd8a491c4c May 19 12:28:41.689280 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-19cea140-ddef-4a86-a3a9-5e0323039f3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:41.690726 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-19cea140-ddef-4a86-a3a9-5e0323039f3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:41.706715 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-19cea140-ddef-4a86-a3a9-5e0323039f3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:41.707892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-19cea140-ddef-4a86-a3a9-5e0323039f3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:41.709532 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-19cea140-ddef-4a86-a3a9-5e0323039f3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:41.710606 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-19cea140-ddef-4a86-a3a9-5e0323039f3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:42.270682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-19cea140-ddef-4a86-a3a9-5e0323039f3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:42.281838 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-19cea140-ddef-4a86-a3a9-5e0323039f3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1367 microversion: 2.1 time: 0.602651 May 19 12:28:42.282502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 324/615] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:41 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1367 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:28:42.397200 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ffd931b0-da25-418a-aa78-b845bc295511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:42.397883 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ffd931b0-da25-418a-aa78-b845bc295511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:42.404425 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ffd931b0-da25-418a-aa78-b845bc295511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:42.404879 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ffd931b0-da25-418a-aa78-b845bc295511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:42.405848 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ffd931b0-da25-418a-aa78-b845bc295511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:42.406270 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ffd931b0-da25-418a-aa78-b845bc295511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:42.566182 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ffd931b0-da25-418a-aa78-b845bc295511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:42.574247 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ffd931b0-da25-418a-aa78-b845bc295511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:42.575775 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ffd931b0-da25-418a-aa78-b845bc295511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:42.576932 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ffd931b0-da25-418a-aa78-b845bc295511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.183689 May 19 12:28:42.577479 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 325/616] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:42 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:42.662220 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9917244e-1387-4d71-b3fc-8076348e5018 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "POST /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/action" status: 202 len: 0 microversion: 2.1 time: 1.227568 May 19 12:28:42.668743 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 292/617] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:28:41 2022] POST /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/action => generated 0 bytes in 1235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:28:42.676051 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3694eedb-d75b-4be5-9a32-c4bb8975a9e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:42.678279 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3694eedb-d75b-4be5-9a32-c4bb8975a9e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:42.697323 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3694eedb-d75b-4be5-9a32-c4bb8975a9e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:42.699304 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-9f67d97c-111a-4330-83a4-645678cd7c32 req-1f959236-8dae-4ea6-87f6-0fcfbe5798e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70659f4e-c927-47dc-a23a-abd0db258731", "tag": "d7221580-bd77-42eb-a222-b1dd8a491c4c"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:42.705851 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3694eedb-d75b-4be5-9a32-c4bb8975a9e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:42.708687 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3694eedb-d75b-4be5-9a32-c4bb8975a9e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:42.709247 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3694eedb-d75b-4be5-9a32-c4bb8975a9e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:42.721010 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-9f67d97c-111a-4330-83a4-645678cd7c32 req-1f959236-8dae-4ea6-87f6-0fcfbe5798e5 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:42.721881 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-9f67d97c-111a-4330-83a4-645678cd7c32 req-1f959236-8dae-4ea6-87f6-0fcfbe5798e5 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:42.749110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-9f67d97c-111a-4330-83a4-645678cd7c32 req-1f959236-8dae-4ea6-87f6-0fcfbe5798e5 service nova] Creating event network-changed:d7221580-bd77-42eb-a222-b1dd8a491c4c for instance 70659f4e-c927-47dc-a23a-abd0db258731 on hv-cinder-77819 May 19 12:28:42.755972 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-9f67d97c-111a-4330-83a4-645678cd7c32 req-1f959236-8dae-4ea6-87f6-0fcfbe5798e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075023 May 19 12:28:42.758366 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 326/618] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:42.946941 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3694eedb-d75b-4be5-9a32-c4bb8975a9e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:42.955312 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3694eedb-d75b-4be5-9a32-c4bb8975a9e1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1760 microversion: 2.1 time: 0.284492 May 19 12:28:42.956089 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 293/619] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:42 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1760 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:43.300505 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-09ecbc79-2285-4fba-9b7c-f12f50b847e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:43.301420 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-09ecbc79-2285-4fba-9b7c-f12f50b847e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:43.309355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-09ecbc79-2285-4fba-9b7c-f12f50b847e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:43.309741 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-09ecbc79-2285-4fba-9b7c-f12f50b847e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:43.310553 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-09ecbc79-2285-4fba-9b7c-f12f50b847e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:43.310994 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-09ecbc79-2285-4fba-9b7c-f12f50b847e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:43.465648 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-09ecbc79-2285-4fba-9b7c-f12f50b847e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:43.474581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-09ecbc79-2285-4fba-9b7c-f12f50b847e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1557 microversion: 2.1 time: 0.178593 May 19 12:28:43.475739 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 327/620] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:28:43 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:28:43.492030 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-02579411-bf3a-4487-993d-14f4a4b4fd28 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:43.497272 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-02579411-bf3a-4487-993d-14f4a4b4fd28 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:43.500134 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-02579411-bf3a-4487-993d-14f4a4b4fd28 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:43.500619 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-02579411-bf3a-4487-993d-14f4a4b4fd28 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:43.501403 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-02579411-bf3a-4487-993d-14f4a4b4fd28 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:43.501842 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-02579411-bf3a-4487-993d-14f4a4b4fd28 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:43.594006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-02579411-bf3a-4487-993d-14f4a4b4fd28 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104155 May 19 12:28:43.594006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 294/621] 10.222.0.57 () {58 vars in 1274 bytes} [Thu May 19 12:28:43 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:43.596273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9c160b74-c6b2-4710-8787-c33d33f2e2e3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:43.596888 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9c160b74-c6b2-4710-8787-c33d33f2e2e3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:43.604313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9c160b74-c6b2-4710-8787-c33d33f2e2e3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:43.604892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9c160b74-c6b2-4710-8787-c33d33f2e2e3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:43.605641 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9c160b74-c6b2-4710-8787-c33d33f2e2e3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:43.606072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9c160b74-c6b2-4710-8787-c33d33f2e2e3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:43.756983 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9c160b74-c6b2-4710-8787-c33d33f2e2e3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:43.770033 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9c160b74-c6b2-4710-8787-c33d33f2e2e3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:43.771795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9c160b74-c6b2-4710-8787-c33d33f2e2e3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:43.773958 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9c160b74-c6b2-4710-8787-c33d33f2e2e3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1739 microversion: 2.20 time: 0.181903 May 19 12:28:43.777344 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 328/622] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:43 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:44.794512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ac9f028a-8a44-47b7-905e-ca12ff5cb637 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:44.795789 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ac9f028a-8a44-47b7-905e-ca12ff5cb637 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:44.803397 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ac9f028a-8a44-47b7-905e-ca12ff5cb637 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:44.804208 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ac9f028a-8a44-47b7-905e-ca12ff5cb637 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:44.805087 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ac9f028a-8a44-47b7-905e-ca12ff5cb637 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:44.805595 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ac9f028a-8a44-47b7-905e-ca12ff5cb637 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:44.976959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ac9f028a-8a44-47b7-905e-ca12ff5cb637 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:44.981567 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:44.986738 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ac9f028a-8a44-47b7-905e-ca12ff5cb637 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:44.988458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ac9f028a-8a44-47b7-905e-ca12ff5cb637 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:44.990188 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ac9f028a-8a44-47b7-905e-ca12ff5cb637 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1721 microversion: 2.20 time: 0.200685 May 19 12:28:44.991038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 295/623] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:44 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:45.359784 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-a9d2aecd-6fb5-4440-a059-9f92a870e70a req-015173a7-f137-4dd7-859e-acca8bd015ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "121221d9-cf95-4729-9331-c2696a743b0b", "tag": "bdc95f17-5855-4791-bcdb-d9206b642684"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:45.371810 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-a9d2aecd-6fb5-4440-a059-9f92a870e70a req-015173a7-f137-4dd7-859e-acca8bd015ce service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:45.372260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-a9d2aecd-6fb5-4440-a059-9f92a870e70a req-015173a7-f137-4dd7-859e-acca8bd015ce service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:45.385786 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:45.388703 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-a9d2aecd-6fb5-4440-a059-9f92a870e70a req-015173a7-f137-4dd7-859e-acca8bd015ce service nova] Creating event network-changed:bdc95f17-5855-4791-bcdb-d9206b642684 for instance 121221d9-cf95-4729-9331-c2696a743b0b on hv-cinder-77819 May 19 12:28:45.394540 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-a9d2aecd-6fb5-4440-a059-9f92a870e70a req-015173a7-f137-4dd7-859e-acca8bd015ce service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039405 May 19 12:28:45.395530 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 329/624] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:28:46.013540 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-00843537-00ad-4654-9d4d-ff754dcda37f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:46.014154 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-00843537-00ad-4654-9d4d-ff754dcda37f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:46.022703 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00843537-00ad-4654-9d4d-ff754dcda37f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:46.023158 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00843537-00ad-4654-9d4d-ff754dcda37f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:46.025543 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00843537-00ad-4654-9d4d-ff754dcda37f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:46.026388 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00843537-00ad-4654-9d4d-ff754dcda37f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:46.193095 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-00843537-00ad-4654-9d4d-ff754dcda37f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:46.203046 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-00843537-00ad-4654-9d4d-ff754dcda37f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:46.204928 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-00843537-00ad-4654-9d4d-ff754dcda37f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:46.206147 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-00843537-00ad-4654-9d4d-ff754dcda37f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1721 microversion: 2.20 time: 0.197720 May 19 12:28:46.206750 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 296/625] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:46 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:47.230644 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-23f94927-01db-487e-a86a-a6864f516886 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:47.232338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-23f94927-01db-487e-a86a-a6864f516886 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:47.242972 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-23f94927-01db-487e-a86a-a6864f516886 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:47.243662 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-23f94927-01db-487e-a86a-a6864f516886 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:47.244811 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-23f94927-01db-487e-a86a-a6864f516886 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:47.245496 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-23f94927-01db-487e-a86a-a6864f516886 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:47.294041 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-c4e41329-b1ea-4a69-9a4e-aebceb455adc req-c9be5231-658f-4676-ac76-aa4c75850efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac0842f-dd21-479d-894c-1080f1531013", "name": "network-vif-unplugged", "status": "completed", "tag": "2ce047fc-9ae8-4336-a545-1e048200c75a"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:47.329075 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c4e41329-b1ea-4a69-9a4e-aebceb455adc req-c9be5231-658f-4676-ac76-aa4c75850efd service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:47.329830 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c4e41329-b1ea-4a69-9a4e-aebceb455adc req-c9be5231-658f-4676-ac76-aa4c75850efd service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:47.348828 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-c4e41329-b1ea-4a69-9a4e-aebceb455adc req-c9be5231-658f-4676-ac76-aa4c75850efd service nova] Creating event network-vif-unplugged:2ce047fc-9ae8-4336-a545-1e048200c75a for instance 1ac0842f-dd21-479d-894c-1080f1531013 on hv-cinder-77819 May 19 12:28:47.356564 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-c4e41329-b1ea-4a69-9a4e-aebceb455adc req-c9be5231-658f-4676-ac76-aa4c75850efd service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066741 May 19 12:28:47.366717 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 297/626] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:28:47.455218 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-23f94927-01db-487e-a86a-a6864f516886 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:47.471598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-23f94927-01db-487e-a86a-a6864f516886 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:47.471598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-23f94927-01db-487e-a86a-a6864f516886 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:47.471598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-23f94927-01db-487e-a86a-a6864f516886 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1721 microversion: 2.20 time: 0.246155 May 19 12:28:47.471997 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 330/627] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:47 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:48.490246 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ae6c7256-ecc6-4c23-ab0d-2c4e609182b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:48.490987 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ae6c7256-ecc6-4c23-ab0d-2c4e609182b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:48.498568 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ae6c7256-ecc6-4c23-ab0d-2c4e609182b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:48.499023 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ae6c7256-ecc6-4c23-ab0d-2c4e609182b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:48.499815 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ae6c7256-ecc6-4c23-ab0d-2c4e609182b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:48.500260 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ae6c7256-ecc6-4c23-ab0d-2c4e609182b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:48.646723 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ae6c7256-ecc6-4c23-ab0d-2c4e609182b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:48.654936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ae6c7256-ecc6-4c23-ab0d-2c4e609182b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:48.656435 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ae6c7256-ecc6-4c23-ab0d-2c4e609182b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:48.657614 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ae6c7256-ecc6-4c23-ab0d-2c4e609182b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1664 microversion: 2.20 time: 0.172254 May 19 12:28:48.658184 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 298/628] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:48 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1664 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:48.675529 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f75182b7-fd0a-4613-8987-142095807376 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ab95be4-71e2-4270-b48f-bf8c31fc8bb7"}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:48.676614 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f75182b7-fd0a-4613-8987-142095807376 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:48.683920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f75182b7-fd0a-4613-8987-142095807376 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:48.684364 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f75182b7-fd0a-4613-8987-142095807376 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:48.685123 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f75182b7-fd0a-4613-8987-142095807376 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:48.685557 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f75182b7-fd0a-4613-8987-142095807376 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:50.098014 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f75182b7-fd0a-4613-8987-142095807376 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "POST /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.426366 May 19 12:28:50.098873 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 331/629] 10.222.0.57 () {62 vars in 1363 bytes} [Thu May 19 12:28:48 2022] POST /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-volume_attachments => generated 188 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:28:50.223811 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1058b3e5-1b43-4ba7-a1d0-33f541398b65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:28:50.224357 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1058b3e5-1b43-4ba7-a1d0-33f541398b65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:50.226812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:50.232323 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1058b3e5-1b43-4ba7-a1d0-33f541398b65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:50.232785 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1058b3e5-1b43-4ba7-a1d0-33f541398b65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:50.233570 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1058b3e5-1b43-4ba7-a1d0-33f541398b65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:50.234007 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1058b3e5-1b43-4ba7-a1d0-33f541398b65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:50.560250 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1058b3e5-1b43-4ba7-a1d0-33f541398b65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "POST /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/action" status: 202 len: 0 microversion: 2.20 time: 0.339831 May 19 12:28:50.561236 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 299/630] 10.222.0.57 () {62 vars in 1318 bytes} [Thu May 19 12:28:50 2022] POST /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 12:28:50.575307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-56cf135a-987b-4201-97ee-25d7a52b4c91 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:50.576805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-56cf135a-987b-4201-97ee-25d7a52b4c91 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:50.588951 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-56cf135a-987b-4201-97ee-25d7a52b4c91 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:50.589750 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-56cf135a-987b-4201-97ee-25d7a52b4c91 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:50.591158 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-56cf135a-987b-4201-97ee-25d7a52b4c91 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:50.592093 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-56cf135a-987b-4201-97ee-25d7a52b4c91 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:50.752286 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-56cf135a-987b-4201-97ee-25d7a52b4c91 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:50.763783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-56cf135a-987b-4201-97ee-25d7a52b4c91 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:50.765358 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-56cf135a-987b-4201-97ee-25d7a52b4c91 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:50.766584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-56cf135a-987b-4201-97ee-25d7a52b4c91 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1750 microversion: 2.20 time: 0.199256 May 19 12:28:50.767149 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 332/631] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:50 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1750 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:51.791528 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-28d50d4d-9a6b-44c4-8c5b-2e718c371b1f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:51.792169 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-28d50d4d-9a6b-44c4-8c5b-2e718c371b1f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:51.799507 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28d50d4d-9a6b-44c4-8c5b-2e718c371b1f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:51.800062 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28d50d4d-9a6b-44c4-8c5b-2e718c371b1f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:51.800843 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28d50d4d-9a6b-44c4-8c5b-2e718c371b1f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:51.801282 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28d50d4d-9a6b-44c4-8c5b-2e718c371b1f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:51.964304 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-28d50d4d-9a6b-44c4-8c5b-2e718c371b1f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:51.980271 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-28d50d4d-9a6b-44c4-8c5b-2e718c371b1f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:51.982051 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-28d50d4d-9a6b-44c4-8c5b-2e718c371b1f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:51.983437 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-28d50d4d-9a6b-44c4-8c5b-2e718c371b1f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1750 microversion: 2.20 time: 0.196948 May 19 12:28:51.984013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 300/632] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:51 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1750 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:53.002743 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3305068c-a4ce-457a-be9a-97fedc4108a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:53.003640 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3305068c-a4ce-457a-be9a-97fedc4108a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:53.011817 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3305068c-a4ce-457a-be9a-97fedc4108a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:53.012184 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3305068c-a4ce-457a-be9a-97fedc4108a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:53.013087 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3305068c-a4ce-457a-be9a-97fedc4108a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:53.013524 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3305068c-a4ce-457a-be9a-97fedc4108a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:53.158212 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3305068c-a4ce-457a-be9a-97fedc4108a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:53.168565 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3305068c-a4ce-457a-be9a-97fedc4108a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:53.170277 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3305068c-a4ce-457a-be9a-97fedc4108a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:53.171641 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3305068c-a4ce-457a-be9a-97fedc4108a9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1752 microversion: 2.20 time: 0.173226 May 19 12:28:53.172272 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 333/633] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:52 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:28:54.191732 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d5387400-de00-49ee-b265-0641142e4f2f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:54.192268 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d5387400-de00-49ee-b265-0641142e4f2f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:54.199593 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d5387400-de00-49ee-b265-0641142e4f2f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:54.200040 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d5387400-de00-49ee-b265-0641142e4f2f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:54.200801 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d5387400-de00-49ee-b265-0641142e4f2f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:54.201230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d5387400-de00-49ee-b265-0641142e4f2f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:54.347505 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d5387400-de00-49ee-b265-0641142e4f2f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:54.358002 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d5387400-de00-49ee-b265-0641142e4f2f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:54.359595 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d5387400-de00-49ee-b265-0641142e4f2f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:54.360799 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d5387400-de00-49ee-b265-0641142e4f2f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1752 microversion: 2.20 time: 0.173107 May 19 12:28:54.361373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 301/634] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:54 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:55.380466 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4da44c99-63a1-48aa-9e43-219f784fb495 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:55.381105 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4da44c99-63a1-48aa-9e43-219f784fb495 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:55.383928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=76 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:28:55.389081 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4da44c99-63a1-48aa-9e43-219f784fb495 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:55.389526 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4da44c99-63a1-48aa-9e43-219f784fb495 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:55.390434 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4da44c99-63a1-48aa-9e43-219f784fb495 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:55.390874 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4da44c99-63a1-48aa-9e43-219f784fb495 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:55.534784 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4da44c99-63a1-48aa-9e43-219f784fb495 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:55.546914 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4da44c99-63a1-48aa-9e43-219f784fb495 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:55.548499 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4da44c99-63a1-48aa-9e43-219f784fb495 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:55.549952 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4da44c99-63a1-48aa-9e43-219f784fb495 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.173502 May 19 12:28:55.550710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 334/635] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:55 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:56.576950 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4db2ae3e-031c-438a-8247-868e42b5f39e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:56.577917 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4db2ae3e-031c-438a-8247-868e42b5f39e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:56.587585 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4db2ae3e-031c-438a-8247-868e42b5f39e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:56.588387 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4db2ae3e-031c-438a-8247-868e42b5f39e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:56.590800 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4db2ae3e-031c-438a-8247-868e42b5f39e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:56.591899 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4db2ae3e-031c-438a-8247-868e42b5f39e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:56.779332 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4db2ae3e-031c-438a-8247-868e42b5f39e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:56.788890 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4db2ae3e-031c-438a-8247-868e42b5f39e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:56.790886 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4db2ae3e-031c-438a-8247-868e42b5f39e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:56.792569 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4db2ae3e-031c-438a-8247-868e42b5f39e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.224778 May 19 12:28:56.793463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 302/636] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:56 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:57.815784 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4b4fa5f4-ddb2-456f-a1ee-e82e899fad88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:57.816508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4b4fa5f4-ddb2-456f-a1ee-e82e899fad88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:57.823492 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4b4fa5f4-ddb2-456f-a1ee-e82e899fad88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:57.824159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4b4fa5f4-ddb2-456f-a1ee-e82e899fad88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:57.824954 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4b4fa5f4-ddb2-456f-a1ee-e82e899fad88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:57.825391 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4b4fa5f4-ddb2-456f-a1ee-e82e899fad88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:58.014010 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4b4fa5f4-ddb2-456f-a1ee-e82e899fad88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:58.023511 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4b4fa5f4-ddb2-456f-a1ee-e82e899fad88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:58.030121 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4b4fa5f4-ddb2-456f-a1ee-e82e899fad88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:58.030121 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4b4fa5f4-ddb2-456f-a1ee-e82e899fad88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.217949 May 19 12:28:58.030121 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 335/637] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:57 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:28:59.047989 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-be743059-9687-43fa-bd42-fa7bbae58a9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:28:59.049140 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-be743059-9687-43fa-bd42-fa7bbae58a9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:28:59.061421 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be743059-9687-43fa-bd42-fa7bbae58a9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:59.062062 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be743059-9687-43fa-bd42-fa7bbae58a9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:59.063515 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be743059-9687-43fa-bd42-fa7bbae58a9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:28:59.064351 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be743059-9687-43fa-bd42-fa7bbae58a9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:28:59.218809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-be743059-9687-43fa-bd42-fa7bbae58a9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:59.227828 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-be743059-9687-43fa-bd42-fa7bbae58a9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:59.230303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-be743059-9687-43fa-bd42-fa7bbae58a9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:28:59.231843 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-be743059-9687-43fa-bd42-fa7bbae58a9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.189679 May 19 12:28:59.239782 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 303/638] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:28:59 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:00.251954 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f052f3d6-c2f6-47a9-bb35-3cbb4facf17f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:00.254221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f052f3d6-c2f6-47a9-bb35-3cbb4facf17f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:00.262875 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f052f3d6-c2f6-47a9-bb35-3cbb4facf17f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:00.263863 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f052f3d6-c2f6-47a9-bb35-3cbb4facf17f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:00.265369 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f052f3d6-c2f6-47a9-bb35-3cbb4facf17f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:00.266043 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f052f3d6-c2f6-47a9-bb35-3cbb4facf17f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:00.467943 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f052f3d6-c2f6-47a9-bb35-3cbb4facf17f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:00.483466 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f052f3d6-c2f6-47a9-bb35-3cbb4facf17f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:00.485893 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f052f3d6-c2f6-47a9-bb35-3cbb4facf17f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:00.487804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f052f3d6-c2f6-47a9-bb35-3cbb4facf17f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.240664 May 19 12:29:00.488623 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 336/639] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:00 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:01.516822 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-591f523f-f6e9-4683-a61f-1adc806720cb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:01.518633 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-591f523f-f6e9-4683-a61f-1adc806720cb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:01.536410 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-591f523f-f6e9-4683-a61f-1adc806720cb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:01.538613 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-591f523f-f6e9-4683-a61f-1adc806720cb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:01.542041 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-591f523f-f6e9-4683-a61f-1adc806720cb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:01.543410 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-591f523f-f6e9-4683-a61f-1adc806720cb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:01.746970 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-591f523f-f6e9-4683-a61f-1adc806720cb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:01.760114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-591f523f-f6e9-4683-a61f-1adc806720cb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:01.762325 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-591f523f-f6e9-4683-a61f-1adc806720cb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:01.764127 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-591f523f-f6e9-4683-a61f-1adc806720cb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.258251 May 19 12:29:01.773776 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 304/640] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:01 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:02.784710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-46eb9190-95de-4549-a24c-d9f8934f524b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:02.786996 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-46eb9190-95de-4549-a24c-d9f8934f524b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:02.797655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-46eb9190-95de-4549-a24c-d9f8934f524b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:02.798314 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-46eb9190-95de-4549-a24c-d9f8934f524b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:02.799402 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-46eb9190-95de-4549-a24c-d9f8934f524b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:02.799983 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-46eb9190-95de-4549-a24c-d9f8934f524b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:02.941850 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-46eb9190-95de-4549-a24c-d9f8934f524b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:02.951471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-46eb9190-95de-4549-a24c-d9f8934f524b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:02.953309 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-46eb9190-95de-4549-a24c-d9f8934f524b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:02.954720 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-46eb9190-95de-4549-a24c-d9f8934f524b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.174875 May 19 12:29:02.955599 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 337/641] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:02 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:03.982259 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-253a94e5-90ac-4521-82b3-6a07175c5e4f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:03.982259 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-253a94e5-90ac-4521-82b3-6a07175c5e4f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:03.992356 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-253a94e5-90ac-4521-82b3-6a07175c5e4f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:03.992900 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-253a94e5-90ac-4521-82b3-6a07175c5e4f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:03.995988 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-253a94e5-90ac-4521-82b3-6a07175c5e4f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:03.996721 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-253a94e5-90ac-4521-82b3-6a07175c5e4f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:04.197488 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-253a94e5-90ac-4521-82b3-6a07175c5e4f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:04.206738 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-253a94e5-90ac-4521-82b3-6a07175c5e4f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:04.208258 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-253a94e5-90ac-4521-82b3-6a07175c5e4f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:04.209433 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-253a94e5-90ac-4521-82b3-6a07175c5e4f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.238764 May 19 12:29:04.210001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 305/642] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:03 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:05.229350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6813fb80-b064-4a7a-ab33-c0905d23103a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:05.230262 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6813fb80-b064-4a7a-ab33-c0905d23103a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:05.242796 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6813fb80-b064-4a7a-ab33-c0905d23103a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:05.243526 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6813fb80-b064-4a7a-ab33-c0905d23103a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:05.244470 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6813fb80-b064-4a7a-ab33-c0905d23103a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:05.245271 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6813fb80-b064-4a7a-ab33-c0905d23103a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:05.424470 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6813fb80-b064-4a7a-ab33-c0905d23103a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:05.435400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6813fb80-b064-4a7a-ab33-c0905d23103a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:05.438592 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6813fb80-b064-4a7a-ab33-c0905d23103a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:05.440269 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6813fb80-b064-4a7a-ab33-c0905d23103a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.215712 May 19 12:29:05.442516 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 338/643] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:05 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:06.459606 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-25f670da-621c-4669-98e0-c075682ff1ca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:06.460290 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-25f670da-621c-4669-98e0-c075682ff1ca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:06.467526 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25f670da-621c-4669-98e0-c075682ff1ca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:06.474835 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25f670da-621c-4669-98e0-c075682ff1ca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:06.474835 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25f670da-621c-4669-98e0-c075682ff1ca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:06.474835 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25f670da-621c-4669-98e0-c075682ff1ca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:06.619946 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-25f670da-621c-4669-98e0-c075682ff1ca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:06.634777 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-25f670da-621c-4669-98e0-c075682ff1ca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:06.638514 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-25f670da-621c-4669-98e0-c075682ff1ca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:06.640526 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-25f670da-621c-4669-98e0-c075682ff1ca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.184853 May 19 12:29:06.641705 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 306/644] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:06 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:07.667887 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0ac01095-ad97-4a49-ad34-621f39f8c5b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:07.669542 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0ac01095-ad97-4a49-ad34-621f39f8c5b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:07.676970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ac01095-ad97-4a49-ad34-621f39f8c5b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:07.678228 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ac01095-ad97-4a49-ad34-621f39f8c5b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:07.679410 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ac01095-ad97-4a49-ad34-621f39f8c5b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:07.680076 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ac01095-ad97-4a49-ad34-621f39f8c5b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:07.830808 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0ac01095-ad97-4a49-ad34-621f39f8c5b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:07.840325 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0ac01095-ad97-4a49-ad34-621f39f8c5b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:07.841857 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0ac01095-ad97-4a49-ad34-621f39f8c5b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:07.843100 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0ac01095-ad97-4a49-ad34-621f39f8c5b4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.179499 May 19 12:29:07.843674 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 339/645] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:07 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:08.862142 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0c8a4c87-bc94-48f9-bf1b-a7a78f96d612 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:08.862786 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0c8a4c87-bc94-48f9-bf1b-a7a78f96d612 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:08.869363 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c8a4c87-bc94-48f9-bf1b-a7a78f96d612 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:08.869806 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c8a4c87-bc94-48f9-bf1b-a7a78f96d612 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:08.871861 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c8a4c87-bc94-48f9-bf1b-a7a78f96d612 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:08.872291 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c8a4c87-bc94-48f9-bf1b-a7a78f96d612 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:09.036220 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0c8a4c87-bc94-48f9-bf1b-a7a78f96d612 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:09.046565 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0c8a4c87-bc94-48f9-bf1b-a7a78f96d612 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:09.048111 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0c8a4c87-bc94-48f9-bf1b-a7a78f96d612 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:09.051270 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0c8a4c87-bc94-48f9-bf1b-a7a78f96d612 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.192874 May 19 12:29:09.051795 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 307/646] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:08 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:10.070959 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-596a3705-64ba-4900-9964-84af5d4b5c42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:10.071599 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-596a3705-64ba-4900-9964-84af5d4b5c42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:10.078785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-596a3705-64ba-4900-9964-84af5d4b5c42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:10.079229 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-596a3705-64ba-4900-9964-84af5d4b5c42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:10.080048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-596a3705-64ba-4900-9964-84af5d4b5c42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:10.080463 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-596a3705-64ba-4900-9964-84af5d4b5c42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:10.223072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-596a3705-64ba-4900-9964-84af5d4b5c42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:10.232785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-596a3705-64ba-4900-9964-84af5d4b5c42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:10.234442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-596a3705-64ba-4900-9964-84af5d4b5c42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:10.235612 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-596a3705-64ba-4900-9964-84af5d4b5c42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.168886 May 19 12:29:10.236171 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 340/647] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:10 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:11.264120 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c02cae35-922f-4561-970f-23a6922522b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:11.264727 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c02cae35-922f-4561-970f-23a6922522b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:11.272407 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c02cae35-922f-4561-970f-23a6922522b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:11.272847 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c02cae35-922f-4561-970f-23a6922522b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:11.273633 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c02cae35-922f-4561-970f-23a6922522b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:11.274063 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c02cae35-922f-4561-970f-23a6922522b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:11.419457 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c02cae35-922f-4561-970f-23a6922522b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:11.428844 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c02cae35-922f-4561-970f-23a6922522b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:11.430767 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c02cae35-922f-4561-970f-23a6922522b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:11.432090 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c02cae35-922f-4561-970f-23a6922522b2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.172592 May 19 12:29:11.433260 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 308/648] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:11 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:12.453760 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6072e084-dae8-461f-8d3e-433c9656b690 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:12.454371 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6072e084-dae8-461f-8d3e-433c9656b690 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:12.462970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6072e084-dae8-461f-8d3e-433c9656b690 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:12.463480 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6072e084-dae8-461f-8d3e-433c9656b690 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:12.464380 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6072e084-dae8-461f-8d3e-433c9656b690 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:12.465065 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6072e084-dae8-461f-8d3e-433c9656b690 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:12.617478 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6072e084-dae8-461f-8d3e-433c9656b690 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:12.631604 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6072e084-dae8-461f-8d3e-433c9656b690 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:12.633706 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6072e084-dae8-461f-8d3e-433c9656b690 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:12.635689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6072e084-dae8-461f-8d3e-433c9656b690 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.187288 May 19 12:29:12.636621 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 341/649] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:12 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:12.654719 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-969cddaf-1d77-4150-8599-2fa5e88d6ee8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83448f12-3782-486d-ae40-774051e1ae8f"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:29:12.655841 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-969cddaf-1d77-4150-8599-2fa5e88d6ee8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:12.663370 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-969cddaf-1d77-4150-8599-2fa5e88d6ee8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:12.665143 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-969cddaf-1d77-4150-8599-2fa5e88d6ee8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:12.665143 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-969cddaf-1d77-4150-8599-2fa5e88d6ee8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:12.665591 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-969cddaf-1d77-4150-8599-2fa5e88d6ee8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:13.659226 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-be995092-ddb7-4df2-b178-6b101c3f8e9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:13.659834 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-be995092-ddb7-4df2-b178-6b101c3f8e9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:13.667376 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-be995092-ddb7-4df2-b178-6b101c3f8e9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:13.667837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-be995092-ddb7-4df2-b178-6b101c3f8e9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:13.668781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-be995092-ddb7-4df2-b178-6b101c3f8e9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:13.669220 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-be995092-ddb7-4df2-b178-6b101c3f8e9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:13.818248 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-be995092-ddb7-4df2-b178-6b101c3f8e9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:13.828061 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-be995092-ddb7-4df2-b178-6b101c3f8e9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:13.829557 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-be995092-ddb7-4df2-b178-6b101c3f8e9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:13.830810 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-be995092-ddb7-4df2-b178-6b101c3f8e9c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.176039 May 19 12:29:13.831381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 342/650] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:13 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:29:14.148656 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-969cddaf-1d77-4150-8599-2fa5e88d6ee8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "POST /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.498503 May 19 12:29:14.149269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 309/651] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:29:12 2022] POST /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments => generated 194 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:29:14.849743 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-08ebdfaf-c1f6-4eb3-9d45-7f4f52271a94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:14.850293 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-08ebdfaf-c1f6-4eb3-9d45-7f4f52271a94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:14.857579 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-08ebdfaf-c1f6-4eb3-9d45-7f4f52271a94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:14.860849 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-08ebdfaf-c1f6-4eb3-9d45-7f4f52271a94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:14.860849 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-08ebdfaf-c1f6-4eb3-9d45-7f4f52271a94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:14.860849 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-08ebdfaf-c1f6-4eb3-9d45-7f4f52271a94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:15.007815 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-08ebdfaf-c1f6-4eb3-9d45-7f4f52271a94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:15.010027 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:15.017064 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-08ebdfaf-c1f6-4eb3-9d45-7f4f52271a94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:15.025309 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-08ebdfaf-c1f6-4eb3-9d45-7f4f52271a94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:15.025309 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-08ebdfaf-c1f6-4eb3-9d45-7f4f52271a94 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.174021 May 19 12:29:15.025309 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 343/652] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:14 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:16.038964 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c2f0afa8-7d4e-4351-8b03-acad9c850442 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:16.039663 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c2f0afa8-7d4e-4351-8b03-acad9c850442 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:16.046099 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c2f0afa8-7d4e-4351-8b03-acad9c850442 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:16.046596 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c2f0afa8-7d4e-4351-8b03-acad9c850442 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:16.047360 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c2f0afa8-7d4e-4351-8b03-acad9c850442 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:16.047796 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c2f0afa8-7d4e-4351-8b03-acad9c850442 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:16.050487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:16.242349 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c2f0afa8-7d4e-4351-8b03-acad9c850442 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:16.251854 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c2f0afa8-7d4e-4351-8b03-acad9c850442 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:16.253530 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c2f0afa8-7d4e-4351-8b03-acad9c850442 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:16.254736 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c2f0afa8-7d4e-4351-8b03-acad9c850442 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.220464 May 19 12:29:16.255383 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 310/653] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:16 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:17.274654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e4a8e723-975e-4e03-9e4e-fb19bf50ace9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:17.275289 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e4a8e723-975e-4e03-9e4e-fb19bf50ace9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:17.283974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e4a8e723-975e-4e03-9e4e-fb19bf50ace9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:17.284427 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e4a8e723-975e-4e03-9e4e-fb19bf50ace9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:17.285208 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e4a8e723-975e-4e03-9e4e-fb19bf50ace9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:17.285647 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e4a8e723-975e-4e03-9e4e-fb19bf50ace9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:17.489796 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e4a8e723-975e-4e03-9e4e-fb19bf50ace9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:17.501495 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e4a8e723-975e-4e03-9e4e-fb19bf50ace9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:17.503072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e4a8e723-975e-4e03-9e4e-fb19bf50ace9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:17.504257 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e4a8e723-975e-4e03-9e4e-fb19bf50ace9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.233951 May 19 12:29:17.505027 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 344/654] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:17 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:18.523214 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b95c37cd-79f6-4920-a7aa-ccbbac193838 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:18.523876 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b95c37cd-79f6-4920-a7aa-ccbbac193838 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:18.535729 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b95c37cd-79f6-4920-a7aa-ccbbac193838 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:18.536465 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b95c37cd-79f6-4920-a7aa-ccbbac193838 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:18.537847 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b95c37cd-79f6-4920-a7aa-ccbbac193838 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:18.538645 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b95c37cd-79f6-4920-a7aa-ccbbac193838 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:18.690018 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b95c37cd-79f6-4920-a7aa-ccbbac193838 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:18.699072 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b95c37cd-79f6-4920-a7aa-ccbbac193838 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:18.700556 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b95c37cd-79f6-4920-a7aa-ccbbac193838 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:18.701718 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b95c37cd-79f6-4920-a7aa-ccbbac193838 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.182412 May 19 12:29:18.702287 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 311/655] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:18 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:19.721948 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4e31b1e2-e7d8-4732-9778-ad60fc32f440 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:19.722548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4e31b1e2-e7d8-4732-9778-ad60fc32f440 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:19.731132 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4e31b1e2-e7d8-4732-9778-ad60fc32f440 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:19.731574 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4e31b1e2-e7d8-4732-9778-ad60fc32f440 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:19.732375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4e31b1e2-e7d8-4732-9778-ad60fc32f440 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:19.732804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4e31b1e2-e7d8-4732-9778-ad60fc32f440 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:19.879638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4e31b1e2-e7d8-4732-9778-ad60fc32f440 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:19.889095 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4e31b1e2-e7d8-4732-9778-ad60fc32f440 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:19.890645 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4e31b1e2-e7d8-4732-9778-ad60fc32f440 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:19.891844 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4e31b1e2-e7d8-4732-9778-ad60fc32f440 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.175168 May 19 12:29:19.892410 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 345/656] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:19 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:20.910659 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e3082081-c452-4cdb-9a36-276ccb4c1123 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:20.911259 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e3082081-c452-4cdb-9a36-276ccb4c1123 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:20.913570 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=28 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:20.918805 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e3082081-c452-4cdb-9a36-276ccb4c1123 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:20.919254 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e3082081-c452-4cdb-9a36-276ccb4c1123 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:20.920023 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e3082081-c452-4cdb-9a36-276ccb4c1123 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:20.920457 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e3082081-c452-4cdb-9a36-276ccb4c1123 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:21.076566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e3082081-c452-4cdb-9a36-276ccb4c1123 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:21.085385 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e3082081-c452-4cdb-9a36-276ccb4c1123 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:21.087100 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e3082081-c452-4cdb-9a36-276ccb4c1123 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:21.088348 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e3082081-c452-4cdb-9a36-276ccb4c1123 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.181590 May 19 12:29:21.089806 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 312/657] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:20 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:22.109643 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6c2e67df-8615-47df-b758-fc94dfef12d2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:22.110253 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6c2e67df-8615-47df-b758-fc94dfef12d2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:22.116995 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c2e67df-8615-47df-b758-fc94dfef12d2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:22.117439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c2e67df-8615-47df-b758-fc94dfef12d2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:22.118302 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c2e67df-8615-47df-b758-fc94dfef12d2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:22.118785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c2e67df-8615-47df-b758-fc94dfef12d2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:22.257512 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6c2e67df-8615-47df-b758-fc94dfef12d2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:22.267028 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6c2e67df-8615-47df-b758-fc94dfef12d2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:22.268547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6c2e67df-8615-47df-b758-fc94dfef12d2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:22.270037 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6c2e67df-8615-47df-b758-fc94dfef12d2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.164270 May 19 12:29:22.270443 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 346/658] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:22 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:22.747797 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5eba2b21-9581-467a-971f-90ce9b29171b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:29:22.748828 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5eba2b21-9581-467a-971f-90ce9b29171b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:22.755374 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5eba2b21-9581-467a-971f-90ce9b29171b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:22.755817 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5eba2b21-9581-467a-971f-90ce9b29171b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:22.756576 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5eba2b21-9581-467a-971f-90ce9b29171b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:22.757007 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5eba2b21-9581-467a-971f-90ce9b29171b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:22.780428 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-5eba2b21-9581-467a-971f-90ce9b29171b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lazy-loading 'flavor' on Instance uuid f7fd7551-12f3-4549-9429-3a9ecd8dd150 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:29:23.144306 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5eba2b21-9581-467a-971f-90ce9b29171b tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "POST /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/action" status: 200 len: 32 microversion: 2.1 time: 0.400942 May 19 12:29:23.144862 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 313/659] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:29:22 2022] POST /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/action => generated 32 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:29:23.154673 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-49c3a6df-8911-4c9a-bcdb-22f11da01294 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:23.155503 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-49c3a6df-8911-4c9a-bcdb-22f11da01294 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:23.162391 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-49c3a6df-8911-4c9a-bcdb-22f11da01294 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:23.162871 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-49c3a6df-8911-4c9a-bcdb-22f11da01294 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:23.163643 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-49c3a6df-8911-4c9a-bcdb-22f11da01294 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:23.164115 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-49c3a6df-8911-4c9a-bcdb-22f11da01294 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:23.300346 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-805a90bf-9272-4bbf-b5b1-6c69e7d2a543 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:23.301044 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-805a90bf-9272-4bbf-b5b1-6c69e7d2a543 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:23.305546 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-49c3a6df-8911-4c9a-bcdb-22f11da01294 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:23.309848 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-805a90bf-9272-4bbf-b5b1-6c69e7d2a543 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:23.310305 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-805a90bf-9272-4bbf-b5b1-6c69e7d2a543 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:23.311122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-805a90bf-9272-4bbf-b5b1-6c69e7d2a543 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:23.311560 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-805a90bf-9272-4bbf-b5b1-6c69e7d2a543 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:23.318898 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-49c3a6df-8911-4c9a-bcdb-22f11da01294 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.168753 May 19 12:29:23.319485 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 347/660] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:23 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:23.480109 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-805a90bf-9272-4bbf-b5b1-6c69e7d2a543 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:23.489277 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-805a90bf-9272-4bbf-b5b1-6c69e7d2a543 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:23.491096 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-805a90bf-9272-4bbf-b5b1-6c69e7d2a543 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:23.492314 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-805a90bf-9272-4bbf-b5b1-6c69e7d2a543 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.196836 May 19 12:29:23.492884 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 314/661] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:23 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:29:23.568600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-699821d8-403f-42e2-b9c4-e714f21a61b3 req-3c6022b9-ece2-4150-9df5-c6cd7d4cdbb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac0842f-dd21-479d-894c-1080f1531013", "name": "network-vif-plugged", "status": "completed", "tag": "2ce047fc-9ae8-4336-a545-1e048200c75a"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:29:23.578955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-699821d8-403f-42e2-b9c4-e714f21a61b3 req-3c6022b9-ece2-4150-9df5-c6cd7d4cdbb6 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:23.579814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-699821d8-403f-42e2-b9c4-e714f21a61b3 req-3c6022b9-ece2-4150-9df5-c6cd7d4cdbb6 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:23.598105 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-699821d8-403f-42e2-b9c4-e714f21a61b3 req-3c6022b9-ece2-4150-9df5-c6cd7d4cdbb6 service nova] Creating event network-vif-plugged:2ce047fc-9ae8-4336-a545-1e048200c75a for instance 1ac0842f-dd21-479d-894c-1080f1531013 on hv-cinder-77819 May 19 12:29:23.609421 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-699821d8-403f-42e2-b9c4-e714f21a61b3 req-3c6022b9-ece2-4150-9df5-c6cd7d4cdbb6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047477 May 19 12:29:23.610835 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 348/662] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:29:24.336828 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6e80936c-f079-4f0e-ba4e-1ec085f55f69 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:24.337487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6e80936c-f079-4f0e-ba4e-1ec085f55f69 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:24.344395 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6e80936c-f079-4f0e-ba4e-1ec085f55f69 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:24.344836 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6e80936c-f079-4f0e-ba4e-1ec085f55f69 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:24.345768 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6e80936c-f079-4f0e-ba4e-1ec085f55f69 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:24.346198 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6e80936c-f079-4f0e-ba4e-1ec085f55f69 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:24.487499 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6e80936c-f079-4f0e-ba4e-1ec085f55f69 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:24.497047 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6e80936c-f079-4f0e-ba4e-1ec085f55f69 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.163985 May 19 12:29:24.497644 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 315/663] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:24 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:24.512150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1db62ae4-4c7a-4ef4-97e9-a7ccd6ad1052 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:24.512843 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1db62ae4-4c7a-4ef4-97e9-a7ccd6ad1052 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:24.519282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1db62ae4-4c7a-4ef4-97e9-a7ccd6ad1052 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:24.519735 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1db62ae4-4c7a-4ef4-97e9-a7ccd6ad1052 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:24.520514 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1db62ae4-4c7a-4ef4-97e9-a7ccd6ad1052 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:24.520950 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1db62ae4-4c7a-4ef4-97e9-a7ccd6ad1052 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:24.666029 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1db62ae4-4c7a-4ef4-97e9-a7ccd6ad1052 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:24.675827 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1db62ae4-4c7a-4ef4-97e9-a7ccd6ad1052 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:24.677402 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1db62ae4-4c7a-4ef4-97e9-a7ccd6ad1052 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:24.678863 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1db62ae4-4c7a-4ef4-97e9-a7ccd6ad1052 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.171634 May 19 12:29:24.679426 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 349/664] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:24 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:25.514981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6e2cc8ca-47bc-4805-8ad7-0800bc426f8c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:25.515636 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6e2cc8ca-47bc-4805-8ad7-0800bc426f8c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:25.522246 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6e2cc8ca-47bc-4805-8ad7-0800bc426f8c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:25.522726 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6e2cc8ca-47bc-4805-8ad7-0800bc426f8c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:25.523504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6e2cc8ca-47bc-4805-8ad7-0800bc426f8c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:25.523919 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6e2cc8ca-47bc-4805-8ad7-0800bc426f8c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:25.658846 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6e2cc8ca-47bc-4805-8ad7-0800bc426f8c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:25.667516 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6e2cc8ca-47bc-4805-8ad7-0800bc426f8c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.156495 May 19 12:29:25.668092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 316/665] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:25 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:25.698184 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-87db71b7-611e-4921-9924-4ba1bc07ea80 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:25.698811 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-87db71b7-611e-4921-9924-4ba1bc07ea80 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:25.701198 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=32 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:25.705894 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-87db71b7-611e-4921-9924-4ba1bc07ea80 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:25.706335 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-87db71b7-611e-4921-9924-4ba1bc07ea80 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:25.707142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-87db71b7-611e-4921-9924-4ba1bc07ea80 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:25.707573 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-87db71b7-611e-4921-9924-4ba1bc07ea80 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:25.841839 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-87db71b7-611e-4921-9924-4ba1bc07ea80 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:25.853684 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-87db71b7-611e-4921-9924-4ba1bc07ea80 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:25.857084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-87db71b7-611e-4921-9924-4ba1bc07ea80 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:25.858254 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-87db71b7-611e-4921-9924-4ba1bc07ea80 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.164013 May 19 12:29:25.858847 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 350/666] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:25 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:26.684764 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b77900d9-1e2c-4a3e-8db2-19caa793884c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:26.685382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b77900d9-1e2c-4a3e-8db2-19caa793884c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:26.691901 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b77900d9-1e2c-4a3e-8db2-19caa793884c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:26.692345 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b77900d9-1e2c-4a3e-8db2-19caa793884c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:26.693107 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b77900d9-1e2c-4a3e-8db2-19caa793884c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:26.693539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b77900d9-1e2c-4a3e-8db2-19caa793884c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:26.878053 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-75f3e88a-d28f-482c-b15c-f3a0f639c63a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:26.878802 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-75f3e88a-d28f-482c-b15c-f3a0f639c63a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:26.885815 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-75f3e88a-d28f-482c-b15c-f3a0f639c63a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:26.886263 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-75f3e88a-d28f-482c-b15c-f3a0f639c63a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:26.887054 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-75f3e88a-d28f-482c-b15c-f3a0f639c63a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:26.887484 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-75f3e88a-d28f-482c-b15c-f3a0f639c63a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:27.041281 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b77900d9-1e2c-4a3e-8db2-19caa793884c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:27.049400 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b77900d9-1e2c-4a3e-8db2-19caa793884c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.368529 May 19 12:29:27.049968 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 317/667] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:26 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:27.063020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-75f3e88a-d28f-482c-b15c-f3a0f639c63a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:27.072173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-75f3e88a-d28f-482c-b15c-f3a0f639c63a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:27.074487 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-75f3e88a-d28f-482c-b15c-f3a0f639c63a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:27.075664 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-75f3e88a-d28f-482c-b15c-f3a0f639c63a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.202566 May 19 12:29:27.076224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 351/668] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:26 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:28.097612 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-71551703-125d-45d8-acaf-28154a3f4ebf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:28.098543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-71551703-125d-45d8-acaf-28154a3f4ebf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:28.105910 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-71551703-125d-45d8-acaf-28154a3f4ebf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:28.106702 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-71551703-125d-45d8-acaf-28154a3f4ebf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:28.107482 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-71551703-125d-45d8-acaf-28154a3f4ebf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:28.108079 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-71551703-125d-45d8-acaf-28154a3f4ebf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:28.198810 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4a28d791-ffe1-4795-b238-af237d3894b4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:28.199777 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4a28d791-ffe1-4795-b238-af237d3894b4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:28.206043 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a28d791-ffe1-4795-b238-af237d3894b4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:28.206594 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a28d791-ffe1-4795-b238-af237d3894b4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:28.207570 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a28d791-ffe1-4795-b238-af237d3894b4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:28.208395 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a28d791-ffe1-4795-b238-af237d3894b4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:28.307655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-71551703-125d-45d8-acaf-28154a3f4ebf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:28.316868 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-71551703-125d-45d8-acaf-28154a3f4ebf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:28.318671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-71551703-125d-45d8-acaf-28154a3f4ebf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:28.323128 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-71551703-125d-45d8-acaf-28154a3f4ebf tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1808 microversion: 2.20 time: 0.226736 May 19 12:29:28.323128 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 352/669] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:28 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:28.367064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4a28d791-ffe1-4795-b238-af237d3894b4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:28.375470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4a28d791-ffe1-4795-b238-af237d3894b4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.311788 May 19 12:29:28.376041 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 318/670] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:28 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:29.340627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d77e1cda-552d-4731-a0c3-c8d3c9ee2279 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:29.341227 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d77e1cda-552d-4731-a0c3-c8d3c9ee2279 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:29.347300 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d77e1cda-552d-4731-a0c3-c8d3c9ee2279 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:29.347749 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d77e1cda-552d-4731-a0c3-c8d3c9ee2279 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:29.348518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d77e1cda-552d-4731-a0c3-c8d3c9ee2279 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:29.348953 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d77e1cda-552d-4731-a0c3-c8d3c9ee2279 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:29.397329 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-175f5c66-2cba-48aa-9db1-cea03425e5a4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:29.398052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-175f5c66-2cba-48aa-9db1-cea03425e5a4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:29.405758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-175f5c66-2cba-48aa-9db1-cea03425e5a4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:29.406303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-175f5c66-2cba-48aa-9db1-cea03425e5a4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:29.407187 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-175f5c66-2cba-48aa-9db1-cea03425e5a4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:29.407696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-175f5c66-2cba-48aa-9db1-cea03425e5a4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:29.542663 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d77e1cda-552d-4731-a0c3-c8d3c9ee2279 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:29.551800 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d77e1cda-552d-4731-a0c3-c8d3c9ee2279 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:29.553616 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d77e1cda-552d-4731-a0c3-c8d3c9ee2279 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:29.554856 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d77e1cda-552d-4731-a0c3-c8d3c9ee2279 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1795 microversion: 2.20 time: 0.219275 May 19 12:29:29.555440 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 353/671] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:29:29 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1795 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:29:29.573455 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-175f5c66-2cba-48aa-9db1-cea03425e5a4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:29.582872 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-175f5c66-2cba-48aa-9db1-cea03425e5a4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.190806 May 19 12:29:29.583468 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 319/672] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:29 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:30.601254 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-efeef92f-cb5e-4f27-aeeb-233ea45a1b65 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:30.601850 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-efeef92f-cb5e-4f27-aeeb-233ea45a1b65 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:30.609533 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-efeef92f-cb5e-4f27-aeeb-233ea45a1b65 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:30.609986 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-efeef92f-cb5e-4f27-aeeb-233ea45a1b65 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:30.610808 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-efeef92f-cb5e-4f27-aeeb-233ea45a1b65 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:30.611288 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-efeef92f-cb5e-4f27-aeeb-233ea45a1b65 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:30.750865 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-efeef92f-cb5e-4f27-aeeb-233ea45a1b65 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:30.759693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-efeef92f-cb5e-4f27-aeeb-233ea45a1b65 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.162357 May 19 12:29:30.760297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 354/673] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:30 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:31.778468 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7c54215a-61b9-404e-abed-2fd58bf24b12 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:31.779069 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7c54215a-61b9-404e-abed-2fd58bf24b12 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:31.785724 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7c54215a-61b9-404e-abed-2fd58bf24b12 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:31.786177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7c54215a-61b9-404e-abed-2fd58bf24b12 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:31.787002 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7c54215a-61b9-404e-abed-2fd58bf24b12 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:31.787438 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7c54215a-61b9-404e-abed-2fd58bf24b12 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:31.919071 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7c54215a-61b9-404e-abed-2fd58bf24b12 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:31.928854 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7c54215a-61b9-404e-abed-2fd58bf24b12 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.155018 May 19 12:29:31.929492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 320/674] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:31 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:32.953855 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c76e38b8-40c4-42d4-baf1-f4fb92a4ab1a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:32.954508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c76e38b8-40c4-42d4-baf1-f4fb92a4ab1a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:32.961313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c76e38b8-40c4-42d4-baf1-f4fb92a4ab1a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:32.961761 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c76e38b8-40c4-42d4-baf1-f4fb92a4ab1a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:32.962568 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c76e38b8-40c4-42d4-baf1-f4fb92a4ab1a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:32.963030 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c76e38b8-40c4-42d4-baf1-f4fb92a4ab1a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:33.102848 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c76e38b8-40c4-42d4-baf1-f4fb92a4ab1a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:33.111913 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c76e38b8-40c4-42d4-baf1-f4fb92a4ab1a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.161951 May 19 12:29:33.112511 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 355/675] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:32 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:29:34.129293 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-baebd6a9-c701-4ff9-b739-ad245d2d7703 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:34.129900 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-baebd6a9-c701-4ff9-b739-ad245d2d7703 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:34.136578 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-baebd6a9-c701-4ff9-b739-ad245d2d7703 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:34.137046 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-baebd6a9-c701-4ff9-b739-ad245d2d7703 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:34.137874 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-baebd6a9-c701-4ff9-b739-ad245d2d7703 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:34.138305 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-baebd6a9-c701-4ff9-b739-ad245d2d7703 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:34.284173 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-baebd6a9-c701-4ff9-b739-ad245d2d7703 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:34.292397 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-baebd6a9-c701-4ff9-b739-ad245d2d7703 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.166820 May 19 12:29:34.294117 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 321/676] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:34 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:35.312257 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-246ae765-88d8-443f-a5d1-482be9e75b5f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:35.312804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-246ae765-88d8-443f-a5d1-482be9e75b5f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:35.319786 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-246ae765-88d8-443f-a5d1-482be9e75b5f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:35.320236 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-246ae765-88d8-443f-a5d1-482be9e75b5f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:35.321029 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-246ae765-88d8-443f-a5d1-482be9e75b5f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:35.321470 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-246ae765-88d8-443f-a5d1-482be9e75b5f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:35.456994 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-246ae765-88d8-443f-a5d1-482be9e75b5f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:35.464383 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-246ae765-88d8-443f-a5d1-482be9e75b5f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.156614 May 19 12:29:35.464955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 356/677] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:35 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:36.482557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-93c483cf-10e4-4dff-a4b7-b27b6f2fc34e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:36.483249 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-93c483cf-10e4-4dff-a4b7-b27b6f2fc34e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:36.490073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-93c483cf-10e4-4dff-a4b7-b27b6f2fc34e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:36.490571 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-93c483cf-10e4-4dff-a4b7-b27b6f2fc34e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:36.491451 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-93c483cf-10e4-4dff-a4b7-b27b6f2fc34e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:36.491922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-93c483cf-10e4-4dff-a4b7-b27b6f2fc34e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:36.626629 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-93c483cf-10e4-4dff-a4b7-b27b6f2fc34e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:36.634683 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-93c483cf-10e4-4dff-a4b7-b27b6f2fc34e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.156185 May 19 12:29:36.635251 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 322/678] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:36 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:37.652690 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d54d0f1b-c024-402c-97a9-d6e7a79576a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:37.653294 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d54d0f1b-c024-402c-97a9-d6e7a79576a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:37.660849 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d54d0f1b-c024-402c-97a9-d6e7a79576a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:37.661294 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d54d0f1b-c024-402c-97a9-d6e7a79576a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:37.662057 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d54d0f1b-c024-402c-97a9-d6e7a79576a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:37.662579 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d54d0f1b-c024-402c-97a9-d6e7a79576a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:37.798222 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d54d0f1b-c024-402c-97a9-d6e7a79576a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:37.806369 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d54d0f1b-c024-402c-97a9-d6e7a79576a3 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.157721 May 19 12:29:37.806962 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 357/679] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:37 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:38.824363 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bd86ee24-5ade-4b66-ae77-9970c765e6b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:38.825043 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bd86ee24-5ade-4b66-ae77-9970c765e6b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:38.832316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd86ee24-5ade-4b66-ae77-9970c765e6b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:38.832771 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd86ee24-5ade-4b66-ae77-9970c765e6b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:38.833546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd86ee24-5ade-4b66-ae77-9970c765e6b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:38.834038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bd86ee24-5ade-4b66-ae77-9970c765e6b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:38.986918 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bd86ee24-5ade-4b66-ae77-9970c765e6b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:38.995512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bd86ee24-5ade-4b66-ae77-9970c765e6b8 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.175121 May 19 12:29:38.996106 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 323/680] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:38 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:40.013705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-03b2aebd-deda-443a-a6b2-52e121724e4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:40.015231 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-03b2aebd-deda-443a-a6b2-52e121724e4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:40.022156 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-03b2aebd-deda-443a-a6b2-52e121724e4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:40.022662 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-03b2aebd-deda-443a-a6b2-52e121724e4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:40.023489 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-03b2aebd-deda-443a-a6b2-52e121724e4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:40.023927 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-03b2aebd-deda-443a-a6b2-52e121724e4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:40.156932 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-03b2aebd-deda-443a-a6b2-52e121724e4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:40.165077 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-03b2aebd-deda-443a-a6b2-52e121724e4a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.155331 May 19 12:29:40.165657 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 358/681] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:40 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:41.183259 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-db146ee8-0e5c-46de-8244-de9551f1affb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:41.183839 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-db146ee8-0e5c-46de-8244-de9551f1affb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:41.191416 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-db146ee8-0e5c-46de-8244-de9551f1affb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:41.191971 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-db146ee8-0e5c-46de-8244-de9551f1affb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:41.192760 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-db146ee8-0e5c-46de-8244-de9551f1affb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:41.193200 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-db146ee8-0e5c-46de-8244-de9551f1affb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:41.343753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-db146ee8-0e5c-46de-8244-de9551f1affb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:41.346100 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:41.352564 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-db146ee8-0e5c-46de-8244-de9551f1affb tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.173199 May 19 12:29:41.357100 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 324/682] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:41 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:42.370215 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2b99ef04-c9aa-4754-9aa3-cdad68b3d957 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:42.370889 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2b99ef04-c9aa-4754-9aa3-cdad68b3d957 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:42.378905 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b99ef04-c9aa-4754-9aa3-cdad68b3d957 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:42.379348 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b99ef04-c9aa-4754-9aa3-cdad68b3d957 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:42.380115 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b99ef04-c9aa-4754-9aa3-cdad68b3d957 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:42.380543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b99ef04-c9aa-4754-9aa3-cdad68b3d957 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:42.516651 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2b99ef04-c9aa-4754-9aa3-cdad68b3d957 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:42.525128 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2b99ef04-c9aa-4754-9aa3-cdad68b3d957 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.158617 May 19 12:29:42.525923 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 359/683] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:42 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:43.543521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-044aaa70-eca7-4a19-8b75-1573c3cfc924 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:43.544121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-044aaa70-eca7-4a19-8b75-1573c3cfc924 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:43.552356 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-044aaa70-eca7-4a19-8b75-1573c3cfc924 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:43.552798 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-044aaa70-eca7-4a19-8b75-1573c3cfc924 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:43.553824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-044aaa70-eca7-4a19-8b75-1573c3cfc924 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:43.554255 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-044aaa70-eca7-4a19-8b75-1573c3cfc924 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:43.686485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-044aaa70-eca7-4a19-8b75-1573c3cfc924 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:43.695186 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-044aaa70-eca7-4a19-8b75-1573c3cfc924 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1735 microversion: 2.1 time: 0.155814 May 19 12:29:43.695767 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 325/684] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:43 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:44.712320 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-22bbd07f-bee5-43a3-ba49-285a3fc213db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:44.712928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-22bbd07f-bee5-43a3-ba49-285a3fc213db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:44.720568 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-22bbd07f-bee5-43a3-ba49-285a3fc213db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:44.721063 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-22bbd07f-bee5-43a3-ba49-285a3fc213db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:44.721891 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-22bbd07f-bee5-43a3-ba49-285a3fc213db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:44.722372 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-22bbd07f-bee5-43a3-ba49-285a3fc213db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:44.867768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-22bbd07f-bee5-43a3-ba49-285a3fc213db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:44.876298 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-22bbd07f-bee5-43a3-ba49-285a3fc213db tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1715 microversion: 2.1 time: 0.167761 May 19 12:29:44.876888 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 360/685] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:44 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:44.938591 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e5eeae6e-d878-41a1-aef5-bd2e32926351 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:44.939662 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e5eeae6e-d878-41a1-aef5-bd2e32926351 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:44.946490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e5eeae6e-d878-41a1-aef5-bd2e32926351 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:44.946943 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e5eeae6e-d878-41a1-aef5-bd2e32926351 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:44.948405 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e5eeae6e-d878-41a1-aef5-bd2e32926351 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:44.948405 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e5eeae6e-d878-41a1-aef5-bd2e32926351 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:45.095422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-e5eeae6e-d878-41a1-aef5-bd2e32926351 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] HTTP exception thrown: Cannot 'detach_volume' instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 while it is in vm_state rescued May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e5eeae6e-d878-41a1-aef5-bd2e32926351 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Request method failure captured: May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments/83448f12-3782-486d-ae40-774051e1ae8f HTTP/1.1 May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjb6x7UOYCybG9-cKm4BV2RSK8mO4iQRuFsCG79T52SfVrJnf6u9-MO1kqqebqKlEz5jWPbyljj0HdBHu4m_dNASD-FoSZU2o4r_16ajVcR7V7lzHTkKXiXAvVeH3F5QXHk3Uva_ii2xPzNguR5JfCHlU4VxOadvL0aWPLAnKNBIeE0 May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: d9e96ed4a3b5430298605d709d353f6e May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:29:45.097504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:29:45.098932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d9e96ed4a3b5430298605d709d353f6e", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:29:45.098932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:29:45.098932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: d9e96ed4a3b5430298605d709d353f6e May 19 12:29:45.098932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:29:45.098932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-ServerRescueNegativeTestJSON-1726578429-project May 19 12:29:45.098932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:29:45.098932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:29:45.098932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 5c35bd3640694b0dbce13c713fd68306 May 19 12:29:45.098932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726578429-project May 19 12:29:45.098932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:29:45.098932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Cannot 'detach_volume' instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 while it is in vm_state rescued May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'server_id': 'f7fd7551-12f3-4549-9429-3a9ecd8dd150', 'id': '83448f12-3782-486d-ae40-774051e1ae8f'} May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:29:45.099601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 while it is in vm_state rescued May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 while it is in vm_state rescued May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:29:45.101017 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e5eeae6e-d878-41a1-aef5-bd2e32926351 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Returning 409 to user: Cannot 'detach_volume' instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 while it is in vm_state rescued {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:29:45.102278 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e5eeae6e-d878-41a1-aef5-bd2e32926351 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments/83448f12-3782-486d-ae40-774051e1ae8f" status: 409 len: 152 microversion: 2.1 time: 0.166058 May 19 12:29:45.102278 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 326/686] 10.222.0.57 () {58 vars in 1415 bytes} [Thu May 19 12:29:44 2022] DELETE /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments/83448f12-3782-486d-ae40-774051e1ae8f => generated 152 bytes in 167 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 12:29:45.113194 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f397f05d-847c-4a37-a894-9710ebc026d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:29:45.113194 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f397f05d-847c-4a37-a894-9710ebc026d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:45.117064 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f397f05d-847c-4a37-a894-9710ebc026d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:45.117202 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f397f05d-847c-4a37-a894-9710ebc026d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:45.117944 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f397f05d-847c-4a37-a894-9710ebc026d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:45.118387 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f397f05d-847c-4a37-a894-9710ebc026d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:45.120879 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:45.400752 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f397f05d-847c-4a37-a894-9710ebc026d7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "POST /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/action" status: 202 len: 0 microversion: 2.1 time: 0.294624 May 19 12:29:45.401417 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 361/687] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:29:45 2022] POST /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:29:45.411837 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e974b49f-f824-4924-a492-75bca896c8fe tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:45.412454 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e974b49f-f824-4924-a492-75bca896c8fe tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:45.420053 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e974b49f-f824-4924-a492-75bca896c8fe tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:45.420505 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e974b49f-f824-4924-a492-75bca896c8fe tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:45.421279 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e974b49f-f824-4924-a492-75bca896c8fe tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:45.421713 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e974b49f-f824-4924-a492-75bca896c8fe tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:45.576808 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e974b49f-f824-4924-a492-75bca896c8fe tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:45.585564 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e974b49f-f824-4924-a492-75bca896c8fe tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1723 microversion: 2.1 time: 0.179663 May 19 12:29:45.586506 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 327/688] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:45 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:46.603715 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4ce452b2-160a-4458-ba0b-f18a44d128f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:46.604422 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4ce452b2-160a-4458-ba0b-f18a44d128f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:46.611654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ce452b2-160a-4458-ba0b-f18a44d128f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:46.612107 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ce452b2-160a-4458-ba0b-f18a44d128f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:46.612891 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ce452b2-160a-4458-ba0b-f18a44d128f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:46.613331 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ce452b2-160a-4458-ba0b-f18a44d128f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:46.753186 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4ce452b2-160a-4458-ba0b-f18a44d128f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:46.766756 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4ce452b2-160a-4458-ba0b-f18a44d128f7 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1723 microversion: 2.1 time: 0.167146 May 19 12:29:46.767506 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 362/689] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:46 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:47.785601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-da10add4-0398-499f-a618-78e8fc68d792 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:47.786209 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-da10add4-0398-499f-a618-78e8fc68d792 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:47.792889 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da10add4-0398-499f-a618-78e8fc68d792 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:47.793334 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da10add4-0398-499f-a618-78e8fc68d792 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:47.794112 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da10add4-0398-499f-a618-78e8fc68d792 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:47.794584 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da10add4-0398-499f-a618-78e8fc68d792 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:47.945568 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-da10add4-0398-499f-a618-78e8fc68d792 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:47.954615 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-da10add4-0398-499f-a618-78e8fc68d792 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1723 microversion: 2.1 time: 0.173432 May 19 12:29:47.955299 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 328/690] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:47 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:48.973204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fd3649c8-d17b-4e73-bcd1-f055006fc931 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:48.974082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fd3649c8-d17b-4e73-bcd1-f055006fc931 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:48.981321 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd3649c8-d17b-4e73-bcd1-f055006fc931 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:48.981809 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd3649c8-d17b-4e73-bcd1-f055006fc931 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:48.982669 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd3649c8-d17b-4e73-bcd1-f055006fc931 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:48.983102 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd3649c8-d17b-4e73-bcd1-f055006fc931 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:49.143371 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fd3649c8-d17b-4e73-bcd1-f055006fc931 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:49.152394 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fd3649c8-d17b-4e73-bcd1-f055006fc931 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1723 microversion: 2.1 time: 0.183913 May 19 12:29:49.152999 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 363/691] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:48 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:50.170941 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c4c44936-619d-4b56-9cfe-836f472f1319 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:50.171866 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c4c44936-619d-4b56-9cfe-836f472f1319 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:50.179581 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4c44936-619d-4b56-9cfe-836f472f1319 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:50.180028 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4c44936-619d-4b56-9cfe-836f472f1319 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:50.183185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4c44936-619d-4b56-9cfe-836f472f1319 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:50.183185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c4c44936-619d-4b56-9cfe-836f472f1319 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:50.557229 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c4c44936-619d-4b56-9cfe-836f472f1319 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:50.565615 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c4c44936-619d-4b56-9cfe-836f472f1319 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1723 microversion: 2.1 time: 0.398796 May 19 12:29:50.566189 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 329/692] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:50 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1723 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:29:51.584041 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6ed9eea8-ee56-426d-8f06-ac760df256a1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:51.584888 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6ed9eea8-ee56-426d-8f06-ac760df256a1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:51.591552 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6ed9eea8-ee56-426d-8f06-ac760df256a1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:51.591997 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6ed9eea8-ee56-426d-8f06-ac760df256a1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:51.592784 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6ed9eea8-ee56-426d-8f06-ac760df256a1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:51.593221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6ed9eea8-ee56-426d-8f06-ac760df256a1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:51.731316 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6ed9eea8-ee56-426d-8f06-ac760df256a1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:51.740886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6ed9eea8-ee56-426d-8f06-ac760df256a1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1729 microversion: 2.1 time: 0.160680 May 19 12:29:51.741469 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 364/693] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:51 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:29:51.757804 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a7699367-ac7b-432e-96fc-f8b100d2dc39 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:51.758323 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a7699367-ac7b-432e-96fc-f8b100d2dc39 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:51.760817 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=36 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:51.766469 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a7699367-ac7b-432e-96fc-f8b100d2dc39 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:51.766983 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a7699367-ac7b-432e-96fc-f8b100d2dc39 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:51.767730 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a7699367-ac7b-432e-96fc-f8b100d2dc39 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:51.768181 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a7699367-ac7b-432e-96fc-f8b100d2dc39 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:51.857881 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a7699367-ac7b-432e-96fc-f8b100d2dc39 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104079 May 19 12:29:51.858510 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 330/694] 10.222.0.57 () {58 vars in 1274 bytes} [Thu May 19 12:29:51 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:29:52.955242 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-587c4e63-04e8-4be5-a1f9-c8f296181802 req-c0cf89c9-34d9-463b-a8eb-0808191d248e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7fd7551-12f3-4549-9429-3a9ecd8dd150", "tag": "849d8b72-d2dd-410e-89b0-e5a60ec6340e"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:29:52.963331 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-587c4e63-04e8-4be5-a1f9-c8f296181802 req-c0cf89c9-34d9-463b-a8eb-0808191d248e service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:52.963768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-587c4e63-04e8-4be5-a1f9-c8f296181802 req-c0cf89c9-34d9-463b-a8eb-0808191d248e service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:52.975415 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-587c4e63-04e8-4be5-a1f9-c8f296181802 req-c0cf89c9-34d9-463b-a8eb-0808191d248e service nova] Creating event network-changed:849d8b72-d2dd-410e-89b0-e5a60ec6340e for instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 on hv-cinder-77819 May 19 12:29:52.980942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-587c4e63-04e8-4be5-a1f9-c8f296181802 req-c0cf89c9-34d9-463b-a8eb-0808191d248e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094276 May 19 12:29:52.981556 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 365/695] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:29:54.118882 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-39219843-f8ac-425e-b3bf-bd3f7b12c2a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:29:54.119959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-39219843-f8ac-425e-b3bf-bd3f7b12c2a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:54.127203 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-39219843-f8ac-425e-b3bf-bd3f7b12c2a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:54.127657 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-39219843-f8ac-425e-b3bf-bd3f7b12c2a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:54.128434 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-39219843-f8ac-425e-b3bf-bd3f7b12c2a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:54.128873 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-39219843-f8ac-425e-b3bf-bd3f7b12c2a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:54.391055 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-39219843-f8ac-425e-b3bf-bd3f7b12c2a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "POST /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/action" status: 202 len: 0 microversion: 2.1 time: 0.275809 May 19 12:29:54.392221 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 331/696] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:29:54 2022] POST /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:29:54.401825 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-84b0b498-95ca-44b0-8449-60d7cedc24b4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:54.402695 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-84b0b498-95ca-44b0-8449-60d7cedc24b4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:54.409728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-84b0b498-95ca-44b0-8449-60d7cedc24b4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:54.410180 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-84b0b498-95ca-44b0-8449-60d7cedc24b4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:54.411004 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-84b0b498-95ca-44b0-8449-60d7cedc24b4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:54.411466 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-84b0b498-95ca-44b0-8449-60d7cedc24b4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:54.571619 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-84b0b498-95ca-44b0-8449-60d7cedc24b4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:54.580651 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-84b0b498-95ca-44b0-8449-60d7cedc24b4 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1752 microversion: 2.1 time: 0.183670 May 19 12:29:54.581242 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 366/697] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:54 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:54.996796 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-090cb003-dc89-4b6d-96ae-60fb84b4ea10 req-c38a7c11-aa97-4d91-8f04-86d90042ebcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7fd7551-12f3-4549-9429-3a9ecd8dd150", "tag": "849d8b72-d2dd-410e-89b0-e5a60ec6340e"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:29:55.005702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-090cb003-dc89-4b6d-96ae-60fb84b4ea10 req-c38a7c11-aa97-4d91-8f04-86d90042ebcc service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:55.006166 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-090cb003-dc89-4b6d-96ae-60fb84b4ea10 req-c38a7c11-aa97-4d91-8f04-86d90042ebcc service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:55.019007 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-090cb003-dc89-4b6d-96ae-60fb84b4ea10 req-c38a7c11-aa97-4d91-8f04-86d90042ebcc service nova] Creating event network-changed:849d8b72-d2dd-410e-89b0-e5a60ec6340e for instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 on hv-cinder-77819 May 19 12:29:55.024286 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-090cb003-dc89-4b6d-96ae-60fb84b4ea10 req-c38a7c11-aa97-4d91-8f04-86d90042ebcc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031445 May 19 12:29:55.025110 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 332/698] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:29:55.598943 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d8120640-93d7-4696-b03c-f20cdb8a36d1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:55.599486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d8120640-93d7-4696-b03c-f20cdb8a36d1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:55.606470 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d8120640-93d7-4696-b03c-f20cdb8a36d1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:55.606927 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d8120640-93d7-4696-b03c-f20cdb8a36d1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:55.607745 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d8120640-93d7-4696-b03c-f20cdb8a36d1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:55.608184 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d8120640-93d7-4696-b03c-f20cdb8a36d1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:55.757857 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d8120640-93d7-4696-b03c-f20cdb8a36d1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:55.767414 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d8120640-93d7-4696-b03c-f20cdb8a36d1 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.172538 May 19 12:29:55.767996 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 367/699] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:55 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:56.786012 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ca79d852-20cb-40ff-8ad0-5079e6579180 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:56.786765 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ca79d852-20cb-40ff-8ad0-5079e6579180 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:56.793139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ca79d852-20cb-40ff-8ad0-5079e6579180 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:56.793589 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ca79d852-20cb-40ff-8ad0-5079e6579180 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:56.794355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ca79d852-20cb-40ff-8ad0-5079e6579180 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:56.794822 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ca79d852-20cb-40ff-8ad0-5079e6579180 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:56.948150 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ca79d852-20cb-40ff-8ad0-5079e6579180 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:56.957555 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ca79d852-20cb-40ff-8ad0-5079e6579180 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.176224 May 19 12:29:56.958133 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 333/700] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:56 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:29:57.974736 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5e083c84-cf1a-4df7-8731-49addf5c90f8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:57.975327 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5e083c84-cf1a-4df7-8731-49addf5c90f8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:57.977753 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=36 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:29:57.982513 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5e083c84-cf1a-4df7-8731-49addf5c90f8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:57.982957 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5e083c84-cf1a-4df7-8731-49addf5c90f8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:57.983720 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5e083c84-cf1a-4df7-8731-49addf5c90f8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:57.984148 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5e083c84-cf1a-4df7-8731-49addf5c90f8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:58.134809 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5e083c84-cf1a-4df7-8731-49addf5c90f8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:58.144555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5e083c84-cf1a-4df7-8731-49addf5c90f8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.173914 May 19 12:29:58.145149 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 368/701] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:57 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:29:58.401743 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-98199a99-a218-4a1e-ad6a-7b00d092bdfb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:58.402282 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-98199a99-a218-4a1e-ad6a-7b00d092bdfb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:58.409541 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-98199a99-a218-4a1e-ad6a-7b00d092bdfb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:58.409993 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-98199a99-a218-4a1e-ad6a-7b00d092bdfb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:58.410809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-98199a99-a218-4a1e-ad6a-7b00d092bdfb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:58.411247 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-98199a99-a218-4a1e-ad6a-7b00d092bdfb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:58.510292 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-98199a99-a218-4a1e-ad6a-7b00d092bdfb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lazy-loading 'services' on Instance uuid c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:29:58.795892 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-98199a99-a218-4a1e-ad6a-7b00d092bdfb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/os-volume_attachments/86aa3f78-0a52-47b4-a7a7-faf4c0bc8b95" status: 202 len: 0 microversion: 2.1 time: 0.505326 May 19 12:29:58.796477 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 334/702] 10.222.0.57 () {58 vars in 1415 bytes} [Thu May 19 12:29:58 2022] DELETE /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/os-volume_attachments/86aa3f78-0a52-47b4-a7a7-faf4c0bc8b95 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:29:59.163159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3fa28941-751d-404e-8acf-091c57fa58ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:29:59.163767 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3fa28941-751d-404e-8acf-091c57fa58ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:29:59.170035 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3fa28941-751d-404e-8acf-091c57fa58ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:59.170531 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3fa28941-751d-404e-8acf-091c57fa58ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:59.171319 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3fa28941-751d-404e-8acf-091c57fa58ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:29:59.171743 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3fa28941-751d-404e-8acf-091c57fa58ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:29:59.348962 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3fa28941-751d-404e-8acf-091c57fa58ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:29:59.359249 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3fa28941-751d-404e-8acf-091c57fa58ba tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.200141 May 19 12:29:59.359854 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 369/703] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:29:59 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:00.378398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-abd60a7f-324a-42be-aa0f-7e94cc4c03ed tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:00.379120 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-abd60a7f-324a-42be-aa0f-7e94cc4c03ed tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:00.385548 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-abd60a7f-324a-42be-aa0f-7e94cc4c03ed tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:00.385998 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-abd60a7f-324a-42be-aa0f-7e94cc4c03ed tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:00.386804 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-abd60a7f-324a-42be-aa0f-7e94cc4c03ed tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:00.387247 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-abd60a7f-324a-42be-aa0f-7e94cc4c03ed tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:00.550087 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-abd60a7f-324a-42be-aa0f-7e94cc4c03ed tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:00.559029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-abd60a7f-324a-42be-aa0f-7e94cc4c03ed tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.185412 May 19 12:30:00.559682 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 335/704] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:00 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:00.983418 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3b60afb7-5c6d-414b-ad4f-91d60c868df6 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:00.990896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3b60afb7-5c6d-414b-ad4f-91d60c868df6 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:00.991344 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3b60afb7-5c6d-414b-ad4f-91d60c868df6 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:01.015006 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3b60afb7-5c6d-414b-ad4f-91d60c868df6 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Going to try to stop instance {{(pid=118112) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 12:30:01.286447 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3b60afb7-5c6d-414b-ad4f-91d60c868df6 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "POST /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/action" status: 202 len: 0 microversion: 2.1 time: 0.306746 May 19 12:30:01.287073 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 370/705] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:30:00 2022] POST /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:30:01.295929 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-06098181-a748-4420-93fe-bbb4c8787249 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:01.304761 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-06098181-a748-4420-93fe-bbb4c8787249 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:01.304761 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06098181-a748-4420-93fe-bbb4c8787249 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:01.305052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06098181-a748-4420-93fe-bbb4c8787249 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:01.305589 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06098181-a748-4420-93fe-bbb4c8787249 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:01.306029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-06098181-a748-4420-93fe-bbb4c8787249 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:01.447088 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-06098181-a748-4420-93fe-bbb4c8787249 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:01.456953 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-06098181-a748-4420-93fe-bbb4c8787249 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.165287 May 19 12:30:01.457898 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 336/706] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:01 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:01.581947 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1e2e7220-8b60-4fe6-9735-49f6d0f8aefc tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:01.582617 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1e2e7220-8b60-4fe6-9735-49f6d0f8aefc tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:01.590536 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1e2e7220-8b60-4fe6-9735-49f6d0f8aefc tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:01.591352 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1e2e7220-8b60-4fe6-9735-49f6d0f8aefc tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:01.592414 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1e2e7220-8b60-4fe6-9735-49f6d0f8aefc tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:01.592859 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1e2e7220-8b60-4fe6-9735-49f6d0f8aefc tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:01.758018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1e2e7220-8b60-4fe6-9735-49f6d0f8aefc tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:01.765899 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1e2e7220-8b60-4fe6-9735-49f6d0f8aefc tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.189467 May 19 12:30:01.767438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 371/707] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:01 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:02.475006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-89c63072-1273-4a32-9162-a7b788804db0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:02.475621 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-89c63072-1273-4a32-9162-a7b788804db0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:02.482213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89c63072-1273-4a32-9162-a7b788804db0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:02.482707 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89c63072-1273-4a32-9162-a7b788804db0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:02.483511 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89c63072-1273-4a32-9162-a7b788804db0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:02.483951 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-89c63072-1273-4a32-9162-a7b788804db0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:02.616896 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-89c63072-1273-4a32-9162-a7b788804db0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:02.624352 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-89c63072-1273-4a32-9162-a7b788804db0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.153332 May 19 12:30:02.624974 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 337/708] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:02 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:02.786021 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-36a4b7c0-95da-4705-8dac-3b85d49b45ef tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:02.786876 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-36a4b7c0-95da-4705-8dac-3b85d49b45ef tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:02.795621 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-36a4b7c0-95da-4705-8dac-3b85d49b45ef tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:02.796069 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-36a4b7c0-95da-4705-8dac-3b85d49b45ef tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:02.796853 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-36a4b7c0-95da-4705-8dac-3b85d49b45ef tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:02.797289 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-36a4b7c0-95da-4705-8dac-3b85d49b45ef tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:02.958338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-36a4b7c0-95da-4705-8dac-3b85d49b45ef tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:02.973683 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-36a4b7c0-95da-4705-8dac-3b85d49b45ef tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.192589 May 19 12:30:02.974282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 372/709] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:02 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:03.642631 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1e6ca0ff-4584-4771-9caa-519142e74c05 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:03.643240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1e6ca0ff-4584-4771-9caa-519142e74c05 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:03.649808 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1e6ca0ff-4584-4771-9caa-519142e74c05 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:03.650303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1e6ca0ff-4584-4771-9caa-519142e74c05 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:03.651098 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1e6ca0ff-4584-4771-9caa-519142e74c05 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:03.651540 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1e6ca0ff-4584-4771-9caa-519142e74c05 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:03.780564 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1e6ca0ff-4584-4771-9caa-519142e74c05 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:03.788647 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1e6ca0ff-4584-4771-9caa-519142e74c05 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.149959 May 19 12:30:03.789215 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 338/710] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:03 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:03.991176 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-60738168-de68-4ceb-b869-cc00225d2cdd tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:03.991735 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-60738168-de68-4ceb-b869-cc00225d2cdd tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:03.998314 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-60738168-de68-4ceb-b869-cc00225d2cdd tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:03.998796 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-60738168-de68-4ceb-b869-cc00225d2cdd tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:03.999557 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-60738168-de68-4ceb-b869-cc00225d2cdd tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:03.999985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-60738168-de68-4ceb-b869-cc00225d2cdd tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:04.155524 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-60738168-de68-4ceb-b869-cc00225d2cdd tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:04.163886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-60738168-de68-4ceb-b869-cc00225d2cdd tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.176517 May 19 12:30:04.164469 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 373/711] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:03 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:04.807770 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0cb18d82-f587-4521-8089-9958ebcfce70 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:04.808417 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0cb18d82-f587-4521-8089-9958ebcfce70 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:04.815843 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0cb18d82-f587-4521-8089-9958ebcfce70 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:04.816288 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0cb18d82-f587-4521-8089-9958ebcfce70 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:04.817076 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0cb18d82-f587-4521-8089-9958ebcfce70 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:04.817510 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0cb18d82-f587-4521-8089-9958ebcfce70 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:04.949589 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0cb18d82-f587-4521-8089-9958ebcfce70 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:04.957142 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0cb18d82-f587-4521-8089-9958ebcfce70 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.153209 May 19 12:30:04.957795 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 339/712] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:04 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:30:05.183844 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9eb66638-0090-4b80-b2bb-80125191446c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:05.184452 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9eb66638-0090-4b80-b2bb-80125191446c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:05.191292 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9eb66638-0090-4b80-b2bb-80125191446c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:05.191744 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9eb66638-0090-4b80-b2bb-80125191446c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:05.192521 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9eb66638-0090-4b80-b2bb-80125191446c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:05.192952 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9eb66638-0090-4b80-b2bb-80125191446c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:05.344223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9eb66638-0090-4b80-b2bb-80125191446c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:05.356737 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9eb66638-0090-4b80-b2bb-80125191446c tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.176593 May 19 12:30:05.357378 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 374/713] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:05 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:05.974135 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-80d5ba79-4b23-4d66-9862-fd0184b5cceb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:05.974784 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-80d5ba79-4b23-4d66-9862-fd0184b5cceb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:05.981266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-80d5ba79-4b23-4d66-9862-fd0184b5cceb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:05.981717 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-80d5ba79-4b23-4d66-9862-fd0184b5cceb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:05.982543 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-80d5ba79-4b23-4d66-9862-fd0184b5cceb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:05.982981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-80d5ba79-4b23-4d66-9862-fd0184b5cceb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:06.117817 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-80d5ba79-4b23-4d66-9862-fd0184b5cceb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:06.120168 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:06.126126 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-80d5ba79-4b23-4d66-9862-fd0184b5cceb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.155848 May 19 12:30:06.126743 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 340/714] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:05 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:06.376062 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-7c6e9d19-1dd4-442a-b9f5-dfb893766329 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:06.376810 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-7c6e9d19-1dd4-442a-b9f5-dfb893766329 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:06.383592 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7c6e9d19-1dd4-442a-b9f5-dfb893766329 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:06.384045 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7c6e9d19-1dd4-442a-b9f5-dfb893766329 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:06.384819 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7c6e9d19-1dd4-442a-b9f5-dfb893766329 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:06.385251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7c6e9d19-1dd4-442a-b9f5-dfb893766329 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:06.542894 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-7c6e9d19-1dd4-442a-b9f5-dfb893766329 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:06.552622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-7c6e9d19-1dd4-442a-b9f5-dfb893766329 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.180317 May 19 12:30:06.553555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 375/715] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:06 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:07.145136 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-98e21627-f61d-4121-ba86-985dc3289cc2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:07.145750 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-98e21627-f61d-4121-ba86-985dc3289cc2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:07.153129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-98e21627-f61d-4121-ba86-985dc3289cc2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:07.153579 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-98e21627-f61d-4121-ba86-985dc3289cc2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:07.154358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-98e21627-f61d-4121-ba86-985dc3289cc2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:07.154831 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-98e21627-f61d-4121-ba86-985dc3289cc2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:07.306372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-98e21627-f61d-4121-ba86-985dc3289cc2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:07.313963 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-98e21627-f61d-4121-ba86-985dc3289cc2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.173479 May 19 12:30:07.314523 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 341/716] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:07 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:07.571816 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-658e2862-b463-4d34-8a03-068befa77c0b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:07.572429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-658e2862-b463-4d34-8a03-068befa77c0b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:07.579709 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-658e2862-b463-4d34-8a03-068befa77c0b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:07.579821 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-658e2862-b463-4d34-8a03-068befa77c0b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:07.581228 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-658e2862-b463-4d34-8a03-068befa77c0b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:07.581672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-658e2862-b463-4d34-8a03-068befa77c0b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:07.598048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:07.735189 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-658e2862-b463-4d34-8a03-068befa77c0b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:07.744436 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-658e2862-b463-4d34-8a03-068befa77c0b tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.176670 May 19 12:30:07.745018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 376/717] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:07 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:08.331378 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-12eabcd1-4655-47c7-baa7-ac53103f2ddd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:08.331945 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-12eabcd1-4655-47c7-baa7-ac53103f2ddd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:08.338378 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12eabcd1-4655-47c7-baa7-ac53103f2ddd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:08.338856 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12eabcd1-4655-47c7-baa7-ac53103f2ddd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:08.339615 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12eabcd1-4655-47c7-baa7-ac53103f2ddd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:08.340047 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12eabcd1-4655-47c7-baa7-ac53103f2ddd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:08.474476 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-12eabcd1-4655-47c7-baa7-ac53103f2ddd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:08.481893 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-12eabcd1-4655-47c7-baa7-ac53103f2ddd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.154943 May 19 12:30:08.482473 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 342/718] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:08 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:08.763001 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-98020e2b-0d77-4dfc-8051-148e7a299ace tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:08.770600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-98020e2b-0d77-4dfc-8051-148e7a299ace tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:08.772422 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-98020e2b-0d77-4dfc-8051-148e7a299ace tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:08.772870 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-98020e2b-0d77-4dfc-8051-148e7a299ace tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:08.773638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-98020e2b-0d77-4dfc-8051-148e7a299ace tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:08.774067 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-98020e2b-0d77-4dfc-8051-148e7a299ace tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:08.936972 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-98020e2b-0d77-4dfc-8051-148e7a299ace tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:08.946275 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-98020e2b-0d77-4dfc-8051-148e7a299ace tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.187466 May 19 12:30:08.946956 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 377/719] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:08 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:09.500567 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0250cca6-266e-4ec2-8f4e-e1d4322c5bbd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:09.501428 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0250cca6-266e-4ec2-8f4e-e1d4322c5bbd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:09.510127 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0250cca6-266e-4ec2-8f4e-e1d4322c5bbd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:09.510668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0250cca6-266e-4ec2-8f4e-e1d4322c5bbd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:09.511561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0250cca6-266e-4ec2-8f4e-e1d4322c5bbd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:09.512006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0250cca6-266e-4ec2-8f4e-e1d4322c5bbd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:09.655404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0250cca6-266e-4ec2-8f4e-e1d4322c5bbd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:09.664483 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0250cca6-266e-4ec2-8f4e-e1d4322c5bbd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.168203 May 19 12:30:09.665076 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 343/720] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:09 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:09.964991 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4972c775-a31a-4373-a74b-e7f2910106d3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:09.965574 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4972c775-a31a-4373-a74b-e7f2910106d3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:09.973045 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4972c775-a31a-4373-a74b-e7f2910106d3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:09.973494 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4972c775-a31a-4373-a74b-e7f2910106d3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:09.974281 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4972c775-a31a-4373-a74b-e7f2910106d3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:09.974749 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4972c775-a31a-4373-a74b-e7f2910106d3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:10.180998 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4972c775-a31a-4373-a74b-e7f2910106d3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:10.190498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4972c775-a31a-4373-a74b-e7f2910106d3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.229073 May 19 12:30:10.191324 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 378/721] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:09 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:10.683117 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ff5b3fde-f008-42fb-8433-30d4e93be8ae tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:10.683987 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ff5b3fde-f008-42fb-8433-30d4e93be8ae tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:10.692797 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff5b3fde-f008-42fb-8433-30d4e93be8ae tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:10.693582 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff5b3fde-f008-42fb-8433-30d4e93be8ae tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:10.694723 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff5b3fde-f008-42fb-8433-30d4e93be8ae tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:10.695453 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ff5b3fde-f008-42fb-8433-30d4e93be8ae tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:10.883439 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ff5b3fde-f008-42fb-8433-30d4e93be8ae tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:10.893659 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ff5b3fde-f008-42fb-8433-30d4e93be8ae tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.214648 May 19 12:30:10.901770 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 344/722] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:10 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:30:11.210845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-05e17cfb-8b08-44fe-99e7-1fdb5ffa277a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:11.211400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-05e17cfb-8b08-44fe-99e7-1fdb5ffa277a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:11.219788 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-05e17cfb-8b08-44fe-99e7-1fdb5ffa277a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:11.220414 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-05e17cfb-8b08-44fe-99e7-1fdb5ffa277a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:11.222339 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-05e17cfb-8b08-44fe-99e7-1fdb5ffa277a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:11.223003 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-05e17cfb-8b08-44fe-99e7-1fdb5ffa277a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:11.421886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-05e17cfb-8b08-44fe-99e7-1fdb5ffa277a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:11.431641 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-05e17cfb-8b08-44fe-99e7-1fdb5ffa277a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.224782 May 19 12:30:11.432405 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 379/723] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:11 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:11.922296 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5df97390-d6b6-4f16-999e-40eb22ece014 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:11.923407 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5df97390-d6b6-4f16-999e-40eb22ece014 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:11.932698 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5df97390-d6b6-4f16-999e-40eb22ece014 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:11.933206 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5df97390-d6b6-4f16-999e-40eb22ece014 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:11.934079 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5df97390-d6b6-4f16-999e-40eb22ece014 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:11.934552 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5df97390-d6b6-4f16-999e-40eb22ece014 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:12.107191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5df97390-d6b6-4f16-999e-40eb22ece014 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:12.116975 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5df97390-d6b6-4f16-999e-40eb22ece014 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.200063 May 19 12:30:12.117799 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 345/724] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:11 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:12.449186 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fcab333a-d00a-471a-8102-cf612db323b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:12.449853 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fcab333a-d00a-471a-8102-cf612db323b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:12.457232 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fcab333a-d00a-471a-8102-cf612db323b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:12.457686 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fcab333a-d00a-471a-8102-cf612db323b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:12.458507 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fcab333a-d00a-471a-8102-cf612db323b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:12.458946 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fcab333a-d00a-471a-8102-cf612db323b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:12.749134 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fcab333a-d00a-471a-8102-cf612db323b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:12.758048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fcab333a-d00a-471a-8102-cf612db323b3 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.312683 May 19 12:30:12.758692 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 380/725] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:12 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:13.134912 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0688f8cd-a84a-46e0-9850-abe0a45bd4c9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:13.135664 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0688f8cd-a84a-46e0-9850-abe0a45bd4c9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:13.148298 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0688f8cd-a84a-46e0-9850-abe0a45bd4c9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:13.148945 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0688f8cd-a84a-46e0-9850-abe0a45bd4c9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:13.150058 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0688f8cd-a84a-46e0-9850-abe0a45bd4c9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:13.150727 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0688f8cd-a84a-46e0-9850-abe0a45bd4c9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:13.363427 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0688f8cd-a84a-46e0-9850-abe0a45bd4c9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:13.374721 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0688f8cd-a84a-46e0-9850-abe0a45bd4c9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.243936 May 19 12:30:13.375358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 346/726] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:13 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:13.779951 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-da302829-0741-4938-8194-045d2864acf5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:13.780603 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-da302829-0741-4938-8194-045d2864acf5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:13.789980 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-da302829-0741-4938-8194-045d2864acf5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:13.790469 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-da302829-0741-4938-8194-045d2864acf5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:13.791263 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-da302829-0741-4938-8194-045d2864acf5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:13.791704 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-da302829-0741-4938-8194-045d2864acf5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:13.986517 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-da302829-0741-4938-8194-045d2864acf5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:13.997811 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-da302829-0741-4938-8194-045d2864acf5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.223180 May 19 12:30:13.998470 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 381/727] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:13 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:14.399315 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-40eee533-d939-4984-b739-7445a99d253d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:14.400334 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-40eee533-d939-4984-b739-7445a99d253d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:14.407588 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40eee533-d939-4984-b739-7445a99d253d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:14.408267 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40eee533-d939-4984-b739-7445a99d253d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:14.409085 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40eee533-d939-4984-b739-7445a99d253d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:14.409520 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40eee533-d939-4984-b739-7445a99d253d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:14.594558 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-40eee533-d939-4984-b739-7445a99d253d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:14.603852 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-40eee533-d939-4984-b739-7445a99d253d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.211626 May 19 12:30:14.604619 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 347/728] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:14 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:15.024065 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-53bcf044-59d4-476d-9788-63f8a42bf265 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:15.025306 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-53bcf044-59d4-476d-9788-63f8a42bf265 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:15.034086 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53bcf044-59d4-476d-9788-63f8a42bf265 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:15.034594 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53bcf044-59d4-476d-9788-63f8a42bf265 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:15.035485 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53bcf044-59d4-476d-9788-63f8a42bf265 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:15.035877 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53bcf044-59d4-476d-9788-63f8a42bf265 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:15.203978 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-53bcf044-59d4-476d-9788-63f8a42bf265 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:15.212668 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-53bcf044-59d4-476d-9788-63f8a42bf265 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.193184 May 19 12:30:15.213263 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 382/729] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:15 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:15.622692 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cbc6eb12-e463-4b6d-b70b-9c32c1150f50 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:15.623568 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cbc6eb12-e463-4b6d-b70b-9c32c1150f50 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:15.631464 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbc6eb12-e463-4b6d-b70b-9c32c1150f50 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:15.631959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbc6eb12-e463-4b6d-b70b-9c32c1150f50 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:15.632857 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbc6eb12-e463-4b6d-b70b-9c32c1150f50 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:15.633316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cbc6eb12-e463-4b6d-b70b-9c32c1150f50 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:15.799770 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cbc6eb12-e463-4b6d-b70b-9c32c1150f50 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:15.808612 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cbc6eb12-e463-4b6d-b70b-9c32c1150f50 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.189922 May 19 12:30:15.809211 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 348/730] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:15 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:16.231009 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ad330eaa-af14-482c-a5f9-8b01067f84a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:16.232308 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ad330eaa-af14-482c-a5f9-8b01067f84a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:16.242711 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ad330eaa-af14-482c-a5f9-8b01067f84a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:16.244648 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ad330eaa-af14-482c-a5f9-8b01067f84a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:16.246105 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ad330eaa-af14-482c-a5f9-8b01067f84a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:16.246930 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ad330eaa-af14-482c-a5f9-8b01067f84a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:16.497842 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ad330eaa-af14-482c-a5f9-8b01067f84a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:16.510235 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ad330eaa-af14-482c-a5f9-8b01067f84a6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1757 microversion: 2.1 time: 0.283743 May 19 12:30:16.511368 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 383/731] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:16 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1757 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:16.827715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-335493c4-c2d6-430e-a32f-d521a398bd0d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:16.828460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-335493c4-c2d6-430e-a32f-d521a398bd0d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:16.836231 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-335493c4-c2d6-430e-a32f-d521a398bd0d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:16.836622 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-335493c4-c2d6-430e-a32f-d521a398bd0d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:16.837430 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-335493c4-c2d6-430e-a32f-d521a398bd0d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:16.838087 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-335493c4-c2d6-430e-a32f-d521a398bd0d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:17.000695 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-335493c4-c2d6-430e-a32f-d521a398bd0d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:17.009547 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-335493c4-c2d6-430e-a32f-d521a398bd0d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1675 microversion: 2.1 time: 0.185882 May 19 12:30:17.016907 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 349/732] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:16 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:30:17.537085 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-515b704a-cc40-4f6b-9c76-59d8d94ba604 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:17.537692 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-515b704a-cc40-4f6b-9c76-59d8d94ba604 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:17.549976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-515b704a-cc40-4f6b-9c76-59d8d94ba604 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:17.550995 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-515b704a-cc40-4f6b-9c76-59d8d94ba604 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:17.551322 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-515b704a-cc40-4f6b-9c76-59d8d94ba604 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:17.551760 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-515b704a-cc40-4f6b-9c76-59d8d94ba604 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:17.742972 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-515b704a-cc40-4f6b-9c76-59d8d94ba604 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:17.753640 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-515b704a-cc40-4f6b-9c76-59d8d94ba604 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1760 microversion: 2.1 time: 0.221667 May 19 12:30:17.754245 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 384/733] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:17 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1760 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:18.035452 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9e89abd6-208f-47c6-adbb-93111087fde2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:18.036249 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9e89abd6-208f-47c6-adbb-93111087fde2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:18.043334 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9e89abd6-208f-47c6-adbb-93111087fde2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:18.043822 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9e89abd6-208f-47c6-adbb-93111087fde2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:18.044636 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9e89abd6-208f-47c6-adbb-93111087fde2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:18.045071 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9e89abd6-208f-47c6-adbb-93111087fde2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:18.196799 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9e89abd6-208f-47c6-adbb-93111087fde2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:18.205723 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9e89abd6-208f-47c6-adbb-93111087fde2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1652 microversion: 2.1 time: 0.174397 May 19 12:30:18.206302 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 350/734] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:18 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1652 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:18.224537 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6e3cb9cc-5833-4538-966a-3c1002276241 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:18.231399 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e3cb9cc-5833-4538-966a-3c1002276241 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:18.231906 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e3cb9cc-5833-4538-966a-3c1002276241 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:18.260234 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6e3cb9cc-5833-4538-966a-3c1002276241 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Going to try to start instance {{(pid=118112) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 12:30:18.646313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6e3cb9cc-5833-4538-966a-3c1002276241 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "POST /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/action" status: 202 len: 0 microversion: 2.1 time: 0.426905 May 19 12:30:18.647146 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 385/735] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:30:18 2022] POST /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 12:30:18.660555 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d71636ff-7415-4b45-b68f-e2104300bcec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:18.663554 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d71636ff-7415-4b45-b68f-e2104300bcec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:18.672134 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d71636ff-7415-4b45-b68f-e2104300bcec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:18.672958 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d71636ff-7415-4b45-b68f-e2104300bcec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:18.674934 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d71636ff-7415-4b45-b68f-e2104300bcec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:18.675725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d71636ff-7415-4b45-b68f-e2104300bcec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:18.835323 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d71636ff-7415-4b45-b68f-e2104300bcec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:18.847312 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d71636ff-7415-4b45-b68f-e2104300bcec tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1661 microversion: 2.1 time: 0.193519 May 19 12:30:18.848311 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 351/736] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:18 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1661 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:19.873122 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-479f8cb8-20a5-4269-865e-fd7665f37565 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:19.873765 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-479f8cb8-20a5-4269-865e-fd7665f37565 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:19.883522 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-479f8cb8-20a5-4269-865e-fd7665f37565 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:19.884161 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-479f8cb8-20a5-4269-865e-fd7665f37565 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:19.885281 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-479f8cb8-20a5-4269-865e-fd7665f37565 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:19.885900 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-479f8cb8-20a5-4269-865e-fd7665f37565 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:20.040412 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-479f8cb8-20a5-4269-865e-fd7665f37565 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:20.052585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-479f8cb8-20a5-4269-865e-fd7665f37565 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1661 microversion: 2.1 time: 0.183864 May 19 12:30:20.053837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 386/737] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:19 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1661 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:21.076869 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f5f432e5-9c74-4b00-8fc5-fece708c9f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:21.077602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f5f432e5-9c74-4b00-8fc5-fece708c9f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:21.086006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5f432e5-9c74-4b00-8fc5-fece708c9f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:21.086491 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5f432e5-9c74-4b00-8fc5-fece708c9f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:21.087316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5f432e5-9c74-4b00-8fc5-fece708c9f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:21.087905 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5f432e5-9c74-4b00-8fc5-fece708c9f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:21.289915 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f5f432e5-9c74-4b00-8fc5-fece708c9f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:21.300675 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f5f432e5-9c74-4b00-8fc5-fece708c9f9e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1665 microversion: 2.1 time: 0.227707 May 19 12:30:21.301830 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 352/738] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:21 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1665 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:27.886471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-636be5b9-e72e-416a-b577-a1411a2bbd63 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:27.886985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-636be5b9-e72e-416a-b577-a1411a2bbd63 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:27.894041 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-636be5b9-e72e-416a-b577-a1411a2bbd63 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:27.894518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-636be5b9-e72e-416a-b577-a1411a2bbd63 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:27.895305 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-636be5b9-e72e-416a-b577-a1411a2bbd63 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:27.895740 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-636be5b9-e72e-416a-b577-a1411a2bbd63 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:27.923343 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-636be5b9-e72e-416a-b577-a1411a2bbd63 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b/ips" status: 200 len: 149 microversion: 2.1 time: 0.151892 May 19 12:30:27.923911 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 387/739] 10.222.0.57 () {58 vars in 1247 bytes} [Thu May 19 12:30:27 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b/ips => generated 149 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:30:27.937279 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8e19690b-8d34-4239-af2a-5622086bfb3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0ca06d3-9df8-40b2-99d6-eefcc48fa708"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:27.939820 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8e19690b-8d34-4239-af2a-5622086bfb3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:27.941692 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=46 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:27.946989 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8e19690b-8d34-4239-af2a-5622086bfb3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:27.951038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8e19690b-8d34-4239-af2a-5622086bfb3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:27.951038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8e19690b-8d34-4239-af2a-5622086bfb3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:27.951038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8e19690b-8d34-4239-af2a-5622086bfb3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:28.037064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-8e19690b-8d34-4239-af2a-5622086bfb3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Invalid volume: volume b0ca06d3-9df8-40b2-99d6-eefcc48fa708 is already attached to instances: 0ba02619-c806-4c69-bef7-857d2fc19405 May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8e19690b-8d34-4239-af2a-5622086bfb3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: POST /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b/os-volume_attachments HTTP/1.1 May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 74 May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:30:28.039092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:30:28.040813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:30:28.040813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:30:28.040813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:30:28.040813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:30:28.040813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:30:28.040813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:30:28.040813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:30:28.040813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:30:28.040813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:30:28.040813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: May 19 12:30:28.040813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {"volumeAttachment": {"volumeId": "b0ca06d3-9df8-40b2-99d6-eefcc48fa708"}} May 19 12:30:28.040813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Invalid volume: volume b0ca06d3-9df8-40b2-99d6-eefcc48fa708 is already attached to instances: 0ba02619-c806-4c69-bef7-857d2fc19405 May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'server_id': '121221d9-cf95-4729-9331-c2696a743b0b', 'body': {'volumeAttachment': {'volumeId': 'b0ca06d3-9df8-40b2-99d6-eefcc48fa708'}}} May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b0ca06d3-9df8-40b2-99d6-eefcc48fa708 is already attached to instances: 0ba02619-c806-4c69-bef7-857d2fc19405 May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:30:28.041699 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b0ca06d3-9df8-40b2-99d6-eefcc48fa708 is already attached to instances: 0ba02619-c806-4c69-bef7-857d2fc19405 May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:28.043148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:28.044824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:28.044824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:28.044824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:28.044824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b0ca06d3-9df8-40b2-99d6-eefcc48fa708 is already attached to instances: 0ba02619-c806-4c69-bef7-857d2fc19405 May 19 12:30:28.044824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:30:28.044824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8e19690b-8d34-4239-af2a-5622086bfb3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 400 to user: Invalid volume: volume b0ca06d3-9df8-40b2-99d6-eefcc48fa708 is already attached to instances: 0ba02619-c806-4c69-bef7-857d2fc19405 {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:28.044824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8e19690b-8d34-4239-af2a-5622086bfb3b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "POST /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107561 May 19 12:30:28.044824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 353/740] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:30:27 2022] POST /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 12:30:28.051073 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f6127651-2a33-4465-b0cf-0ddf969aaedc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:28.051579 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f6127651-2a33-4465-b0cf-0ddf969aaedc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:28.053823 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=40 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:28.059583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f6127651-2a33-4465-b0cf-0ddf969aaedc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:28.060035 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f6127651-2a33-4465-b0cf-0ddf969aaedc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:28.060810 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f6127651-2a33-4465-b0cf-0ddf969aaedc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:28.061251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f6127651-2a33-4465-b0cf-0ddf969aaedc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:28.086995 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f6127651-2a33-4465-b0cf-0ddf969aaedc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Going to try to terminate instance {{(pid=118112) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:30:28.561455 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f6127651-2a33-4465-b0cf-0ddf969aaedc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 204 len: 0 microversion: 2.1 time: 0.514529 May 19 12:30:28.562071 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 388/741] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:30:28 2022] DELETE /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:30:28.570806 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bde102cf-ce3e-405c-b6c0-38f044e08c43 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:28.571416 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bde102cf-ce3e-405c-b6c0-38f044e08c43 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:28.577938 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bde102cf-ce3e-405c-b6c0-38f044e08c43 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:28.580461 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bde102cf-ce3e-405c-b6c0-38f044e08c43 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:28.580461 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bde102cf-ce3e-405c-b6c0-38f044e08c43 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:28.580908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bde102cf-ce3e-405c-b6c0-38f044e08c43 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:28.718573 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bde102cf-ce3e-405c-b6c0-38f044e08c43 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:28.726545 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bde102cf-ce3e-405c-b6c0-38f044e08c43 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1681 microversion: 2.1 time: 0.159679 May 19 12:30:28.727111 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 354/742] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:28 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:29.745516 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9d362ebd-f614-4411-8be2-4b7b83978d69 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:29.746217 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9d362ebd-f614-4411-8be2-4b7b83978d69 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:29.753561 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9d362ebd-f614-4411-8be2-4b7b83978d69 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:29.754014 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9d362ebd-f614-4411-8be2-4b7b83978d69 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:29.754840 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9d362ebd-f614-4411-8be2-4b7b83978d69 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:29.755280 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9d362ebd-f614-4411-8be2-4b7b83978d69 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:29.903230 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9d362ebd-f614-4411-8be2-4b7b83978d69 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:29.911016 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9d362ebd-f614-4411-8be2-4b7b83978d69 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1681 microversion: 2.1 time: 0.169888 May 19 12:30:29.911590 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 389/743] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:29 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:30.929027 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dea44833-cf99-48c9-a9b6-a7fcd92a7784 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:30.929568 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dea44833-cf99-48c9-a9b6-a7fcd92a7784 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:30.943816 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dea44833-cf99-48c9-a9b6-a7fcd92a7784 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:30.944918 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dea44833-cf99-48c9-a9b6-a7fcd92a7784 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:30.945839 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dea44833-cf99-48c9-a9b6-a7fcd92a7784 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:30.946368 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dea44833-cf99-48c9-a9b6-a7fcd92a7784 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:31.211798 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dea44833-cf99-48c9-a9b6-a7fcd92a7784 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:31.221295 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dea44833-cf99-48c9-a9b6-a7fcd92a7784 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1681 microversion: 2.1 time: 0.295990 May 19 12:30:31.221906 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 355/744] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:30 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1681 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:31.801705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-f4d38379-bace-4182-9358-754e1eb92040 req-9988b643-eaf4-48b4-be57-cbcb2481f57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "121221d9-cf95-4729-9331-c2696a743b0b", "name": "network-vif-deleted", "tag": "bdc95f17-5855-4791-bcdb-d9206b642684"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:31.810820 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-f4d38379-bace-4182-9358-754e1eb92040 req-9988b643-eaf4-48b4-be57-cbcb2481f57d service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:31.811265 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-f4d38379-bace-4182-9358-754e1eb92040 req-9988b643-eaf4-48b4-be57-cbcb2481f57d service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:31.826056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-f4d38379-bace-4182-9358-754e1eb92040 req-9988b643-eaf4-48b4-be57-cbcb2481f57d service nova] Creating event network-vif-deleted:bdc95f17-5855-4791-bcdb-d9206b642684 for instance 121221d9-cf95-4729-9331-c2696a743b0b on hv-cinder-77819 May 19 12:30:31.832676 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-f4d38379-bace-4182-9358-754e1eb92040 req-9988b643-eaf4-48b4-be57-cbcb2481f57d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035094 May 19 12:30:31.833693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 390/745] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:30:32.242257 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a83639f5-2dcb-4f2a-8f30-8412f0bb66c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:32.243332 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a83639f5-2dcb-4f2a-8f30-8412f0bb66c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:32.250368 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a83639f5-2dcb-4f2a-8f30-8412f0bb66c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:32.252238 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a83639f5-2dcb-4f2a-8f30-8412f0bb66c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:32.254314 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a83639f5-2dcb-4f2a-8f30-8412f0bb66c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:32.254314 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a83639f5-2dcb-4f2a-8f30-8412f0bb66c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:32.291446 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a83639f5-2dcb-4f2a-8f30-8412f0bb66c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:32.292320 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a83639f5-2dcb-4f2a-8f30-8412f0bb66c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:32.292936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-a83639f5-2dcb-4f2a-8f30-8412f0bb66c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lazy-loading 'fault' on Instance uuid 121221d9-cf95-4729-9331-c2696a743b0b {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:30:32.343665 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a83639f5-2dcb-4f2a-8f30-8412f0bb66c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:32.353671 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a83639f5-2dcb-4f2a-8f30-8412f0bb66c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 200 len: 1331 microversion: 2.1 time: 0.115029 May 19 12:30:32.354252 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 356/746] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:32 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:33.373360 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-724ca620-dfa0-464c-a208-2d9d6f6dcae4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:33.374231 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-724ca620-dfa0-464c-a208-2d9d6f6dcae4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:33.380857 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-724ca620-dfa0-464c-a208-2d9d6f6dcae4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:33.381334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-724ca620-dfa0-464c-a208-2d9d6f6dcae4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:33.382128 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-724ca620-dfa0-464c-a208-2d9d6f6dcae4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:33.382588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-724ca620-dfa0-464c-a208-2d9d6f6dcae4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:33.396075 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-724ca620-dfa0-464c-a208-2d9d6f6dcae4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-724ca620-dfa0-464c-a208-2d9d6f6dcae4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b HTTP/1.1 May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:30:33.397689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:30:33.399221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:30:33.399221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:30:33.399221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:30:33.399221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:30:33.399221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:30:33.399221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:30:33.399221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:30:33.399221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:30:33.399221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:30:33.399221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:30:33.399221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:30:33.399221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '121221d9-cf95-4729-9331-c2696a743b0b'} May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:33.400056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:30:33.401416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:33.402793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-724ca620-dfa0-464c-a208-2d9d6f6dcae4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 404 to user: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:33.402793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-724ca620-dfa0-464c-a208-2d9d6f6dcae4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 404 len: 111 microversion: 2.1 time: 0.030927 May 19 12:30:33.403105 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 391/747] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:33 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:30:33.415001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f69ef661-bd9d-4d48-9fd5-5032cc05f330 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '.version_select at 0x7fd454d99a60>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:33.418279 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f69ef661-bd9d-4d48-9fd5-5032cc05f330 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [2a8a6541-8d6e-47ed-8832-94acd8958e2c] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 12:30:34.428775 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO oslo.messaging._drivers.impl_rabbit [None req-f69ef661-bd9d-4d48-9fd5-5032cc05f330 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [2a8a6541-8d6e-47ed-8832-94acd8958e2c] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 32946. May 19 12:30:34.540304 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f69ef661-bd9d-4d48-9fd5-5032cc05f330 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175638416" status: 202 len: 0 microversion: 2.1 time: 1.130142 May 19 12:30:34.540900 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 357/748] 10.222.0.57 () {58 vars in 1220 bytes} [Thu May 19 12:30:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1175638416 => generated 0 bytes in 1137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:30:35.546288 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3bdaa8b9-64fe-43c1-b797-4dd33d9ccb29 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:35.553657 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3bdaa8b9-64fe-43c1-b797-4dd33d9ccb29 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:35.555087 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3bdaa8b9-64fe-43c1-b797-4dd33d9ccb29 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:35.555536 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3bdaa8b9-64fe-43c1-b797-4dd33d9ccb29 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:35.556382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3bdaa8b9-64fe-43c1-b797-4dd33d9ccb29 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:35.556744 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3bdaa8b9-64fe-43c1-b797-4dd33d9ccb29 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:35.559852 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:35.687022 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-3bdaa8b9-64fe-43c1-b797-4dd33d9ccb29 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lazy-loading 'services' on Instance uuid 0ba02619-c806-4c69-bef7-857d2fc19405 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:30:36.009124 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3bdaa8b9-64fe-43c1-b797-4dd33d9ccb29 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/os-volume_attachments/b0ca06d3-9df8-40b2-99d6-eefcc48fa708" status: 202 len: 0 microversion: 2.1 time: 0.464369 May 19 12:30:36.009124 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 392/749] 10.222.0.57 () {58 vars in 1415 bytes} [Thu May 19 12:30:35 2022] DELETE /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/os-volume_attachments/b0ca06d3-9df8-40b2-99d6-eefcc48fa708 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:30:36.017560 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bfe54dcd-7b62-461a-acf1-90dcbca293fe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:36.020141 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bfe54dcd-7b62-461a-acf1-90dcbca293fe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:36.027630 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfe54dcd-7b62-461a-acf1-90dcbca293fe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:36.028078 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfe54dcd-7b62-461a-acf1-90dcbca293fe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:36.028849 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfe54dcd-7b62-461a-acf1-90dcbca293fe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:36.029279 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfe54dcd-7b62-461a-acf1-90dcbca293fe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:36.031844 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:36.059947 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bfe54dcd-7b62-461a-acf1-90dcbca293fe tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047784 May 19 12:30:36.060503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 358/750] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:30:36 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:30:37.072956 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f488c33f-68f5-4009-9074-cd0b564bdb7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:37.073979 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f488c33f-68f5-4009-9074-cd0b564bdb7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:37.083120 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f488c33f-68f5-4009-9074-cd0b564bdb7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:37.083570 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f488c33f-68f5-4009-9074-cd0b564bdb7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:37.084346 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f488c33f-68f5-4009-9074-cd0b564bdb7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:37.084787 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f488c33f-68f5-4009-9074-cd0b564bdb7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:37.129984 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f488c33f-68f5-4009-9074-cd0b564bdb7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061699 May 19 12:30:37.130886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 393/751] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:30:37 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:30:38.142578 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a2b4b00b-45c5-4bd9-b759-4911a23466e2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:38.143566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a2b4b00b-45c5-4bd9-b759-4911a23466e2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:38.150640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a2b4b00b-45c5-4bd9-b759-4911a23466e2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:38.151178 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a2b4b00b-45c5-4bd9-b759-4911a23466e2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:38.152079 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a2b4b00b-45c5-4bd9-b759-4911a23466e2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:38.152589 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a2b4b00b-45c5-4bd9-b759-4911a23466e2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:38.182665 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a2b4b00b-45c5-4bd9-b759-4911a23466e2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045206 May 19 12:30:38.183227 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 359/752] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:30:38 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:30:38.243879 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-908e26ff-7548-472f-99a1-7f08aebd22e6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:38.244452 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-908e26ff-7548-472f-99a1-7f08aebd22e6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:38.252375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-908e26ff-7548-472f-99a1-7f08aebd22e6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:38.252583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-908e26ff-7548-472f-99a1-7f08aebd22e6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:38.253394 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-908e26ff-7548-472f-99a1-7f08aebd22e6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:38.254035 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-908e26ff-7548-472f-99a1-7f08aebd22e6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:38.286218 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-908e26ff-7548-472f-99a1-7f08aebd22e6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Going to try to terminate instance {{(pid=118112) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:30:38.596543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-908e26ff-7548-472f-99a1-7f08aebd22e6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 204 len: 0 microversion: 2.1 time: 0.356045 May 19 12:30:38.597068 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 394/753] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:30:38 2022] DELETE /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:30:38.608514 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4df555bd-f1ef-4a98-92f0-c9b45c540e73 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:38.609133 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4df555bd-f1ef-4a98-92f0-c9b45c540e73 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:38.616753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4df555bd-f1ef-4a98-92f0-c9b45c540e73 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:38.622474 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4df555bd-f1ef-4a98-92f0-c9b45c540e73 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:38.622474 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4df555bd-f1ef-4a98-92f0-c9b45c540e73 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:38.622474 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4df555bd-f1ef-4a98-92f0-c9b45c540e73 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:38.755056 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4df555bd-f1ef-4a98-92f0-c9b45c540e73 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:38.763007 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4df555bd-f1ef-4a98-92f0-c9b45c540e73 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1681 microversion: 2.1 time: 0.161518 May 19 12:30:38.763876 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 360/754] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:38 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:30:39.780153 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d4852d1a-9061-4dd2-8a6a-ad5e1f05af42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:39.780929 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d4852d1a-9061-4dd2-8a6a-ad5e1f05af42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:39.787660 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d4852d1a-9061-4dd2-8a6a-ad5e1f05af42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:39.788102 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d4852d1a-9061-4dd2-8a6a-ad5e1f05af42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:39.788872 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d4852d1a-9061-4dd2-8a6a-ad5e1f05af42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:39.789295 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d4852d1a-9061-4dd2-8a6a-ad5e1f05af42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:39.927307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d4852d1a-9061-4dd2-8a6a-ad5e1f05af42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:39.935263 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d4852d1a-9061-4dd2-8a6a-ad5e1f05af42 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1681 microversion: 2.1 time: 0.159264 May 19 12:30:39.936054 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 395/755] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:39 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:40.954548 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8bb4b0ce-d744-422f-b58e-8aaf38fdaaf6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:40.955760 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8bb4b0ce-d744-422f-b58e-8aaf38fdaaf6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:40.964365 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8bb4b0ce-d744-422f-b58e-8aaf38fdaaf6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:40.964938 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8bb4b0ce-d744-422f-b58e-8aaf38fdaaf6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:40.965697 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8bb4b0ce-d744-422f-b58e-8aaf38fdaaf6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:40.966141 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8bb4b0ce-d744-422f-b58e-8aaf38fdaaf6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:41.042643 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8bb4b0ce-d744-422f-b58e-8aaf38fdaaf6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:41.052746 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8bb4b0ce-d744-422f-b58e-8aaf38fdaaf6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1614 microversion: 2.1 time: 0.101698 May 19 12:30:41.055033 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 361/756] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:40 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1614 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:41.252094 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-0c834f26-4d98-447f-866f-d19bf58dab2a req-95347eed-76a8-46e7-baec-42d099361f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba02619-c806-4c69-bef7-857d2fc19405", "name": "network-vif-deleted", "tag": "6e55cf88-9446-44e0-ba62-600e8724a7ee"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:41.265966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-0c834f26-4d98-447f-866f-d19bf58dab2a req-95347eed-76a8-46e7-baec-42d099361f10 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:41.266499 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-0c834f26-4d98-447f-866f-d19bf58dab2a req-95347eed-76a8-46e7-baec-42d099361f10 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:41.284315 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-0c834f26-4d98-447f-866f-d19bf58dab2a req-95347eed-76a8-46e7-baec-42d099361f10 service nova] Creating event network-vif-deleted:6e55cf88-9446-44e0-ba62-600e8724a7ee for instance 0ba02619-c806-4c69-bef7-857d2fc19405 on hv-cinder-77819 May 19 12:30:41.290706 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-0c834f26-4d98-447f-866f-d19bf58dab2a req-95347eed-76a8-46e7-baec-42d099361f10 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043212 May 19 12:30:41.291712 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 396/757] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:30:42.076138 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0a9a0576-ee74-4830-aa67-c48e9d36e153 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:42.076138 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0a9a0576-ee74-4830-aa67-c48e9d36e153 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:42.081580 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a9a0576-ee74-4830-aa67-c48e9d36e153 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:42.082631 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a9a0576-ee74-4830-aa67-c48e9d36e153 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:42.083700 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a9a0576-ee74-4830-aa67-c48e9d36e153 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:42.085052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a9a0576-ee74-4830-aa67-c48e9d36e153 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:42.128486 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a9a0576-ee74-4830-aa67-c48e9d36e153 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:42.129192 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a9a0576-ee74-4830-aa67-c48e9d36e153 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:42.129674 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-0a9a0576-ee74-4830-aa67-c48e9d36e153 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lazy-loading 'fault' on Instance uuid 0ba02619-c806-4c69-bef7-857d2fc19405 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:30:42.183291 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0a9a0576-ee74-4830-aa67-c48e9d36e153 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:42.191806 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0a9a0576-ee74-4830-aa67-c48e9d36e153 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 200 len: 1332 microversion: 2.1 time: 0.122774 May 19 12:30:42.192464 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 362/758] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:42 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 1332 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:30:43.211522 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-92fba0f2-9c97-4525-8496-f8c37fcb169f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:43.212219 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-92fba0f2-9c97-4525-8496-f8c37fcb169f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:43.219119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-92fba0f2-9c97-4525-8496-f8c37fcb169f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:43.225139 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-92fba0f2-9c97-4525-8496-f8c37fcb169f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:43.225139 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-92fba0f2-9c97-4525-8496-f8c37fcb169f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:43.225139 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-92fba0f2-9c97-4525-8496-f8c37fcb169f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:43.236024 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-92fba0f2-9c97-4525-8496-f8c37fcb169f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-92fba0f2-9c97-4525-8496-f8c37fcb169f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 HTTP/1.1 May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:30:43.237795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:30:43.239442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:30:43.239442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:30:43.239442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:30:43.239442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:30:43.239442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:30:43.239442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:30:43.239442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:30:43.239442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:30:43.239442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:30:43.239442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:30:43.239442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:30:43.239442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '0ba02619-c806-4c69-bef7-857d2fc19405'} May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:43.240160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:30:43.241439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:43.242529 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-92fba0f2-9c97-4525-8496-f8c37fcb169f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 404 to user: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:43.242529 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-92fba0f2-9c97-4525-8496-f8c37fcb169f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 404 len: 111 microversion: 2.1 time: 0.032970 May 19 12:30:43.242529 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 397/759] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:43 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:30:43.252270 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b1f29117-37cf-41fe-a7aa-965136fe5444 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '.version_select at 0x7fd454d99040>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:43.403703 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b1f29117-37cf-41fe-a7aa-965136fe5444 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647004569" status: 202 len: 0 microversion: 2.1 time: 0.156158 May 19 12:30:43.404291 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 363/760] 10.222.0.57 () {58 vars in 1220 bytes} [Thu May 19 12:30:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647004569 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:30:44.339440 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-42c04805-4615-4abe-a117-002e5588da53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Action: 'create', calling method: .version_select at 0x7fd4556e0940>, body: {"keypair": {"name": "tempest-keypair-1257794112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLbGgqqv1j7xzxGWbYmYiY0Ux+RAxvR59XsmgrLbGWZfJww+HViLKhSJjn34G/1m26hnLyZb9NcwxTYOY4Q3XI2XgPIWBb8aXzzon2pNhB04c1qZo3IoeK0b+VdmKzKkcw=="}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:44.356518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-42c04805-4615-4abe-a117-002e5588da53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for project 86c353f6ded643e6b501ec57800fafc6. Resources: {'key_pairs'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:30:44.360721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-42c04805-4615-4abe-a117-002e5588da53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for user f0a98f1c068843a684f6765d41cc4e49 and project 86c353f6ded643e6b501ec57800fafc6. Resources: {'key_pairs'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:30:44.380274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR oslo.messaging._drivers.impl_rabbit [None req-42c04805-4615-4abe-a117-002e5588da53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [d6827b1e-5312-4338-b73f-7352bfc4cf3d] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 12:30:45.388278 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO oslo.messaging._drivers.impl_rabbit [None req-42c04805-4615-4abe-a117-002e5588da53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [d6827b1e-5312-4338-b73f-7352bfc4cf3d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 33006. May 19 12:30:45.472610 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-42c04805-4615-4abe-a117-002e5588da53 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.137476 May 19 12:30:45.473226 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 398/761] 10.222.0.57 () {60 vars in 1158 bytes} [Thu May 19 12:30:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:30:46.381930 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9d46c390-9fd7-4151-84c4-c49b655897ec tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:46.383090 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9d46c390-9fd7-4151-84c4-c49b655897ec tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:46.390177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d46c390-9fd7-4151-84c4-c49b655897ec tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:46.390655 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d46c390-9fd7-4151-84c4-c49b655897ec tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:46.391436 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d46c390-9fd7-4151-84c4-c49b655897ec tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:46.391877 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9d46c390-9fd7-4151-84c4-c49b655897ec tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:46.422574 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9d46c390-9fd7-4151-84c4-c49b655897ec tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-volume_attachments/3ab95be4-71e2-4270-b48f-bf8c31fc8bb7" status: 200 len: 194 microversion: 2.20 time: 0.153546 May 19 12:30:46.423158 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 364/762] 10.222.0.57 () {60 vars in 1453 bytes} [Thu May 19 12:30:46 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-volume_attachments/3ab95be4-71e2-4270-b48f-bf8c31fc8bb7 => generated 194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 12:30:46.496028 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-09071c40-f6e3-4581-8271-d08c89b3424f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:46.496686 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-09071c40-f6e3-4581-8271-d08c89b3424f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:46.502747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-09071c40-f6e3-4581-8271-d08c89b3424f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:46.503201 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-09071c40-f6e3-4581-8271-d08c89b3424f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:46.503979 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-09071c40-f6e3-4581-8271-d08c89b3424f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:46.504418 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-09071c40-f6e3-4581-8271-d08c89b3424f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:46.594324 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-09071c40-f6e3-4581-8271-d08c89b3424f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lazy-loading 'services' on Instance uuid 1ac0842f-dd21-479d-894c-1080f1531013 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:30:46.967079 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-09071c40-f6e3-4581-8271-d08c89b3424f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-volume_attachments/3ab95be4-71e2-4270-b48f-bf8c31fc8bb7" status: 202 len: 0 microversion: 2.20 time: 0.475923 May 19 12:30:46.969336 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 399/763] 10.222.0.57 () {60 vars in 1456 bytes} [Thu May 19 12:30:46 2022] DELETE /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-volume_attachments/3ab95be4-71e2-4270-b48f-bf8c31fc8bb7 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 12:30:46.980887 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-47ad15fa-5bf6-4d7d-b692-58e6828ba40b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:46.982237 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-47ad15fa-5bf6-4d7d-b692-58e6828ba40b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:46.990080 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-47ad15fa-5bf6-4d7d-b692-58e6828ba40b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:46.990692 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-47ad15fa-5bf6-4d7d-b692-58e6828ba40b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:46.991565 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-47ad15fa-5bf6-4d7d-b692-58e6828ba40b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:46.992086 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-47ad15fa-5bf6-4d7d-b692-58e6828ba40b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:47.033851 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-47ad15fa-5bf6-4d7d-b692-58e6828ba40b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057934 May 19 12:30:47.034819 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 365/764] 10.222.0.57 () {60 vars in 1342 bytes} [Thu May 19 12:30:46 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:30:48.048133 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0a17f853-68f9-427b-ba2b-19153659f4f0 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:48.050545 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0a17f853-68f9-427b-ba2b-19153659f4f0 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:48.057351 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0a17f853-68f9-427b-ba2b-19153659f4f0 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:48.057848 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0a17f853-68f9-427b-ba2b-19153659f4f0 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:48.058599 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0a17f853-68f9-427b-ba2b-19153659f4f0 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:48.059035 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0a17f853-68f9-427b-ba2b-19153659f4f0 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:48.091411 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0a17f853-68f9-427b-ba2b-19153659f4f0 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048325 May 19 12:30:48.091981 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 400/765] 10.222.0.57 () {60 vars in 1342 bytes} [Thu May 19 12:30:48 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:30:48.198895 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-197755074", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9b89124-2c1b-4572-adaf-f3ca44cc01f0"}], "security_groups": [{"name": "tempest-securitygroup--1359328021"}], "key_name": "tempest-keypair-1257794112", "user_data": "}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:48.315478 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] validate_networks() for [('c9b89124-2c1b-4572-adaf-f3ca44cc01f0', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:30:48.777344 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:30:48.777768 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:30:48.778245 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:30:48.778742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:30:48.779107 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:30:48.790012 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:48.790485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:48.792965 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:48.792965 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:48.809702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for project 86c353f6ded643e6b501ec57800fafc6. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:30:48.814661 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for user f0a98f1c068843a684f6765d41cc4e49 and project 86c353f6ded643e6b501ec57800fafc6. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:30:48.826293 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:30:48.828543 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:30:48.993258 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e26cc770-6b3a-40c2-9055-a6b9a3ff5a03 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.798469 May 19 12:30:48.993907 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 366/766] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:30:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:30:49.005071 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b91aeca7-3ded-4350-adc4-e23d8d52b3c4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:49.005754 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b91aeca7-3ded-4350-adc4-e23d8d52b3c4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:49.074810 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b91aeca7-3ded-4350-adc4-e23d8d52b3c4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:49.083564 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b91aeca7-3ded-4350-adc4-e23d8d52b3c4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1241 microversion: 2.1 time: 0.083085 May 19 12:30:49.084068 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 401/767] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:48 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:30:49.104957 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6231fdfb-b9af-4ffd-af7d-9b21962982c3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:49.105942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6231fdfb-b9af-4ffd-af7d-9b21962982c3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:49.113561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6231fdfb-b9af-4ffd-af7d-9b21962982c3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:49.114008 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6231fdfb-b9af-4ffd-af7d-9b21962982c3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:49.114817 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6231fdfb-b9af-4ffd-af7d-9b21962982c3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:49.115253 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6231fdfb-b9af-4ffd-af7d-9b21962982c3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:49.144430 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6231fdfb-b9af-4ffd-af7d-9b21962982c3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043442 May 19 12:30:49.145026 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 367/768] 10.222.0.57 () {60 vars in 1342 bytes} [Thu May 19 12:30:49 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:49.206647 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c78fd5fa-2eec-4754-ba55-075286e3a462 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:49.207146 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c78fd5fa-2eec-4754-ba55-075286e3a462 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:49.213609 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c78fd5fa-2eec-4754-ba55-075286e3a462 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:49.214055 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c78fd5fa-2eec-4754-ba55-075286e3a462 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:49.214862 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c78fd5fa-2eec-4754-ba55-075286e3a462 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:49.215418 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c78fd5fa-2eec-4754-ba55-075286e3a462 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:49.245760 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c78fd5fa-2eec-4754-ba55-075286e3a462 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Going to try to terminate instance {{(pid=118112) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:30:49.584326 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c78fd5fa-2eec-4754-ba55-075286e3a462 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 204 len: 0 microversion: 2.20 time: 0.381415 May 19 12:30:49.584917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 402/769] 10.222.0.57 () {60 vars in 1279 bytes} [Thu May 19 12:30:49 2022] DELETE /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 12:30:49.593362 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4a0407fa-c1b9-4aef-8aa6-955557cb134f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:49.593961 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4a0407fa-c1b9-4aef-8aa6-955557cb134f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:49.601493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a0407fa-c1b9-4aef-8aa6-955557cb134f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:49.601938 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a0407fa-c1b9-4aef-8aa6-955557cb134f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:49.602734 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a0407fa-c1b9-4aef-8aa6-955557cb134f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:49.603182 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4a0407fa-c1b9-4aef-8aa6-955557cb134f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:49.747561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4a0407fa-c1b9-4aef-8aa6-955557cb134f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:49.756318 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4a0407fa-c1b9-4aef-8aa6-955557cb134f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:49.757810 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4a0407fa-c1b9-4aef-8aa6-955557cb134f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:49.759001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4a0407fa-c1b9-4aef-8aa6-955557cb134f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.169594 May 19 12:30:49.759559 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 368/770] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:30:49 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:30:50.104342 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e6f99378-7e26-4048-8557-f6cfb98a63a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:50.105737 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e6f99378-7e26-4048-8557-f6cfb98a63a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:50.177655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e6f99378-7e26-4048-8557-f6cfb98a63a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:50.186588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e6f99378-7e26-4048-8557-f6cfb98a63a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1241 microversion: 2.1 time: 0.088557 May 19 12:30:50.187165 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 403/771] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:50 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:50.779579 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6bbd9aaf-71f6-4909-b3db-0e499f8a3790 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:50.780377 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6bbd9aaf-71f6-4909-b3db-0e499f8a3790 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:50.787626 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6bbd9aaf-71f6-4909-b3db-0e499f8a3790 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:50.788087 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6bbd9aaf-71f6-4909-b3db-0e499f8a3790 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:50.788875 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6bbd9aaf-71f6-4909-b3db-0e499f8a3790 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:50.789319 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6bbd9aaf-71f6-4909-b3db-0e499f8a3790 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:50.928740 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6bbd9aaf-71f6-4909-b3db-0e499f8a3790 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:50.936929 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6bbd9aaf-71f6-4909-b3db-0e499f8a3790 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:50.938442 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6bbd9aaf-71f6-4909-b3db-0e499f8a3790 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:50.939811 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6bbd9aaf-71f6-4909-b3db-0e499f8a3790 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.164728 May 19 12:30:50.941300 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 369/772] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:30:50 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:30:51.204444 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b15b5e6b-0472-45f3-9e8b-11cbed615b33 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:51.204974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b15b5e6b-0472-45f3-9e8b-11cbed615b33 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:51.268409 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b15b5e6b-0472-45f3-9e8b-11cbed615b33 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:51.279650 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b15b5e6b-0472-45f3-9e8b-11cbed615b33 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1241 microversion: 2.1 time: 0.079116 May 19 12:30:51.280303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 404/773] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:51 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:51.959228 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a5a65441-2b93-4e4d-bc78-cef7ae0e1ada tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:51.959907 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a5a65441-2b93-4e4d-bc78-cef7ae0e1ada tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:51.966844 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a5a65441-2b93-4e4d-bc78-cef7ae0e1ada tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:51.967299 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a5a65441-2b93-4e4d-bc78-cef7ae0e1ada tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:51.968056 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a5a65441-2b93-4e4d-bc78-cef7ae0e1ada tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:51.968484 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a5a65441-2b93-4e4d-bc78-cef7ae0e1ada tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:52.235916 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a5a65441-2b93-4e4d-bc78-cef7ae0e1ada tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:52.244809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a5a65441-2b93-4e4d-bc78-cef7ae0e1ada tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:52.246350 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a5a65441-2b93-4e4d-bc78-cef7ae0e1ada tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:52.247619 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a5a65441-2b93-4e4d-bc78-cef7ae0e1ada tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1723 microversion: 2.20 time: 0.292594 May 19 12:30:52.248192 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 370/774] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:30:51 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:30:52.297398 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b1f3e4c5-d126-41d8-8fdf-67d1bcfe2ba4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:52.297940 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b1f3e4c5-d126-41d8-8fdf-67d1bcfe2ba4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:52.364358 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b1f3e4c5-d126-41d8-8fdf-67d1bcfe2ba4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:52.371233 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b1f3e4c5-d126-41d8-8fdf-67d1bcfe2ba4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1241 microversion: 2.1 time: 0.078012 May 19 12:30:52.372007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 405/775] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:52 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:52.849696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-c25c1d52-582f-47c4-974a-5ca1150de2a7 req-0a64f2e9-a51c-4099-9391-c373d05e109e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac0842f-dd21-479d-894c-1080f1531013", "name": "network-vif-deleted", "tag": "2ce047fc-9ae8-4336-a545-1e048200c75a"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:52.858095 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c25c1d52-582f-47c4-974a-5ca1150de2a7 req-0a64f2e9-a51c-4099-9391-c373d05e109e service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:52.858561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-c25c1d52-582f-47c4-974a-5ca1150de2a7 req-0a64f2e9-a51c-4099-9391-c373d05e109e service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:52.870751 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-c25c1d52-582f-47c4-974a-5ca1150de2a7 req-0a64f2e9-a51c-4099-9391-c373d05e109e service nova] Creating event network-vif-deleted:2ce047fc-9ae8-4336-a545-1e048200c75a for instance 1ac0842f-dd21-479d-894c-1080f1531013 on hv-cinder-77819 May 19 12:30:52.876574 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-c25c1d52-582f-47c4-974a-5ca1150de2a7 req-0a64f2e9-a51c-4099-9391-c373d05e109e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032670 May 19 12:30:52.877306 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 371/776] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:30:53.269693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-78647a1e-0143-480c-8f33-2de576e81ff9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:53.270456 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-78647a1e-0143-480c-8f33-2de576e81ff9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:53.276947 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78647a1e-0143-480c-8f33-2de576e81ff9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:53.277475 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78647a1e-0143-480c-8f33-2de576e81ff9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:53.282993 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78647a1e-0143-480c-8f33-2de576e81ff9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:53.282993 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78647a1e-0143-480c-8f33-2de576e81ff9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:53.312212 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78647a1e-0143-480c-8f33-2de576e81ff9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:53.312884 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78647a1e-0143-480c-8f33-2de576e81ff9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:53.313194 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-78647a1e-0143-480c-8f33-2de576e81ff9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lazy-loading 'fault' on Instance uuid 1ac0842f-dd21-479d-894c-1080f1531013 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:30:53.360278 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-78647a1e-0143-480c-8f33-2de576e81ff9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:53.369251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-78647a1e-0143-480c-8f33-2de576e81ff9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:53.370823 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-78647a1e-0143-480c-8f33-2de576e81ff9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:53.372009 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-78647a1e-0143-480c-8f33-2de576e81ff9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 200 len: 1370 microversion: 2.20 time: 0.106999 May 19 12:30:53.372921 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 406/777] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:30:53 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 1370 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:30:53.390832 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fc776afd-91f6-4bb1-81c0-e5c35caaa159 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:53.392385 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fc776afd-91f6-4bb1-81c0-e5c35caaa159 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:53.398954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fc776afd-91f6-4bb1-81c0-e5c35caaa159 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:53.399484 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fc776afd-91f6-4bb1-81c0-e5c35caaa159 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:53.400616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fc776afd-91f6-4bb1-81c0-e5c35caaa159 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:53.401117 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fc776afd-91f6-4bb1-81c0-e5c35caaa159 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:53.465395 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-fc776afd-91f6-4bb1-81c0-e5c35caaa159 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:53.473715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fc776afd-91f6-4bb1-81c0-e5c35caaa159 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1245 microversion: 2.1 time: 0.087816 May 19 12:30:53.474298 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 372/778] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:53 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:30:54.390797 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b9d3566a-3148-4d0a-ac12-55d39a4cc67e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:54.391399 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b9d3566a-3148-4d0a-ac12-55d39a4cc67e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:54.399519 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b9d3566a-3148-4d0a-ac12-55d39a4cc67e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:54.422638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b9d3566a-3148-4d0a-ac12-55d39a4cc67e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:54.422638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b9d3566a-3148-4d0a-ac12-55d39a4cc67e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:54.422638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b9d3566a-3148-4d0a-ac12-55d39a4cc67e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:54.422638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-b9d3566a-3148-4d0a-ac12-55d39a4cc67e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] HTTP exception thrown: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b9d3566a-3148-4d0a-ac12-55d39a4cc67e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Request method failure captured: May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 HTTP/1.1 May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb_pA3YbFvgpYeHEaLyARNwGe1_6vmlClchqkfb-wUW-87GPWnT_vFt38C5VPmskKLe8Tzko2xBrpkDZDmMJVWHsn2Y4WAFiaUQMl5fYAXltmMPR2JmCQqvZnS-HYBMvIcsc780v-Mv5WvRs2kPR6xpuLuhA0mMTwflCpNF9vaJg7U May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Openstack-Nova-Api-Version: 2.20 May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 1231585c94524ec199c47bd4f4162578 May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:30:54.423150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:30:54.424734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1231585c94524ec199c47bd4f4162578"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1231585c94524ec199c47bd4f4162578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1231585c94524ec199c47bd4f4162578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1231585c94524ec199c47bd4f4162578", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:30:54.424734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:30:54.424734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 1231585c94524ec199c47bd4f4162578 May 19 12:30:54.424734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:30:54.424734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeShelveTestJSON-1308427986-project May 19 12:30:54.424734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:30:54.424734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:30:54.424734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 746a70534fe5419ebe6d5e97a7a041f1 May 19 12:30:54.424734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1308427986-project May 19 12:30:54.424734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:30:54.424734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:30:54.424734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '1ac0842f-dd21-479d-894c-1080f1531013'} May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:30:54.425903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:30:54.427385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:30:54.428955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b9d3566a-3148-4d0a-ac12-55d39a4cc67e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Returning 404 to user: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:30:54.428955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b9d3566a-3148-4d0a-ac12-55d39a4cc67e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 404 len: 111 microversion: 2.20 time: 0.032411 May 19 12:30:54.428955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 407/779] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:30:54 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 12:30:54.429626 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ace65906-80e4-47dc-972d-60b4fa1c8f5f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '.version_select at 0x7fd455026700>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:54.491835 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ab9b4e15-c20e-4df8-8c69-79b198a829e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:54.492442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ab9b4e15-c20e-4df8-8c69-79b198a829e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:54.498682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ab9b4e15-c20e-4df8-8c69-79b198a829e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:54.499126 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ab9b4e15-c20e-4df8-8c69-79b198a829e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:54.499942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ab9b4e15-c20e-4df8-8c69-79b198a829e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:54.500393 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ab9b4e15-c20e-4df8-8c69-79b198a829e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:54.565349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ab9b4e15-c20e-4df8-8c69-79b198a829e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:54.568211 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ace65906-80e4-47dc-972d-60b4fa1c8f5f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-443020323" status: 204 len: 0 microversion: 2.20 time: 0.143105 May 19 12:30:54.568811 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 373/780] 10.222.0.57 () {60 vars in 1258 bytes} [Thu May 19 12:30:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-443020323 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 12:30:54.573919 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ab9b4e15-c20e-4df8-8c69-79b198a829e4 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1245 microversion: 2.1 time: 0.086670 May 19 12:30:54.574772 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 408/781] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:54 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:30:55.438842 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a320b4b2-25ea-417b-a1c0-175c5049bab5 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Action: 'create', calling method: .version_select at 0x7fd454fef4c0>, body: {"keypair": {"name": "tempest-keypair-1646212378", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg7WdWjNz54HXSfK+w8PMcjoRf48KDG4MURQot2y338T0UyR5Nkp2Yyk/TCUzkPltevVUBZoRt3YNBMhMx7P6rUbDBkGRQ7KKYOg0Wa+Qei77LBndmRq8rLlg5TCoHVRw=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:55.454530 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-a320b4b2-25ea-417b-a1c0-175c5049bab5 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Getting quotas for project 1231585c94524ec199c47bd4f4162578. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:30:55.459322 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-a320b4b2-25ea-417b-a1c0-175c5049bab5 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Getting quotas for user 746a70534fe5419ebe6d5e97a7a041f1 and project 1231585c94524ec199c47bd4f4162578. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:30:55.573622 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a320b4b2-25ea-417b-a1c0-175c5049bab5 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.138837 May 19 12:30:55.576280 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 374/782] 10.222.0.57 () {62 vars in 1199 bytes} [Thu May 19 12:30:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 12:30:55.593623 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e6cefd1c-1813-4d58-9d2a-bffdb4bafcfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:55.595178 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e6cefd1c-1813-4d58-9d2a-bffdb4bafcfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:55.602544 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e6cefd1c-1813-4d58-9d2a-bffdb4bafcfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:55.604054 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e6cefd1c-1813-4d58-9d2a-bffdb4bafcfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:55.604188 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e6cefd1c-1813-4d58-9d2a-bffdb4bafcfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:55.604581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e6cefd1c-1813-4d58-9d2a-bffdb4bafcfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:55.684970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e6cefd1c-1813-4d58-9d2a-bffdb4bafcfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:55.694804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e6cefd1c-1813-4d58-9d2a-bffdb4bafcfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1301 microversion: 2.1 time: 0.105271 May 19 12:30:55.704646 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 409/783] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:55 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1301 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:56.715874 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b935b70c-1c72-4a31-a11b-de6eb4332100 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:56.716768 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b935b70c-1c72-4a31-a11b-de6eb4332100 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:56.723864 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b935b70c-1c72-4a31-a11b-de6eb4332100 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:56.724513 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b935b70c-1c72-4a31-a11b-de6eb4332100 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:56.725582 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b935b70c-1c72-4a31-a11b-de6eb4332100 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:56.726126 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b935b70c-1c72-4a31-a11b-de6eb4332100 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:56.990484 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b935b70c-1c72-4a31-a11b-de6eb4332100 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:56.999010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b935b70c-1c72-4a31-a11b-de6eb4332100 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1367 microversion: 2.1 time: 0.287410 May 19 12:30:56.999929 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 375/784] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:56 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:57.614637 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-b501edec-5087-4711-886e-f405855e510e req-5abb2b97-2fc8-49c2-b978-559da5980582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd02616-e81f-4372-89c1-8a9f63588512", "tag": "b000d5e8-7d43-43d1-b1d5-88228f892e8f"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:57.628808 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-b501edec-5087-4711-886e-f405855e510e req-5abb2b97-2fc8-49c2-b978-559da5980582 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:57.629324 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-b501edec-5087-4711-886e-f405855e510e req-5abb2b97-2fc8-49c2-b978-559da5980582 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:57.643248 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-b501edec-5087-4711-886e-f405855e510e req-5abb2b97-2fc8-49c2-b978-559da5980582 service nova] Creating event network-changed:b000d5e8-7d43-43d1-b1d5-88228f892e8f for instance 5bd02616-e81f-4372-89c1-8a9f63588512 on hv-cinder-77819 May 19 12:30:57.647701 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-b501edec-5087-4711-886e-f405855e510e req-5abb2b97-2fc8-49c2-b978-559da5980582 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039162 May 19 12:30:57.648386 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 410/785] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:30:58.016395 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e41e61cb-b594-46c2-ac87-49a609010f7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:58.029306 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e41e61cb-b594-46c2-ac87-49a609010f7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:58.035059 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e41e61cb-b594-46c2-ac87-49a609010f7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:58.035486 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e41e61cb-b594-46c2-ac87-49a609010f7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:58.036358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e41e61cb-b594-46c2-ac87-49a609010f7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:58.036863 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e41e61cb-b594-46c2-ac87-49a609010f7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:58.254117 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1878912065", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95564b1d-433e-4b0e-8ac1-53dd3bc3d04f"}], "security_groups": [{"name": "tempest-securitygroup--873338959"}], "key_name": "tempest-keypair-1646212378", "user_data": "}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:30:58.260969 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:58.475660 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.network.neutron [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] validate_networks() for [('95564b1d-433e-4b0e-8ac1-53dd3bc3d04f', None, None, None, None, None)] {{(pid=118112) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:30:58.568929 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e41e61cb-b594-46c2-ac87-49a609010f7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:58.576553 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e41e61cb-b594-46c2-ac87-49a609010f7e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1367 microversion: 2.1 time: 0.564051 May 19 12:30:58.577152 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 376/786] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:58 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1367 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:30:59.079880 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Flavor limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:30:59.080628 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Image limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:30:59.080806 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Flavor pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:30:59.081196 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Image pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:30:59.081613 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:30:59.091614 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:59.092068 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:59.092882 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:59.093326 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:59.111448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Getting quotas for project 1231585c94524ec199c47bd4f4162578. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:30:59.116793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Getting quotas for user 746a70534fe5419ebe6d5e97a7a041f1 and project 1231585c94524ec199c47bd4f4162578. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:30:59.130664 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Going to run 1 instances... {{(pid=118112) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:30:59.133390 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:30:59.273520 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e528115b-8e2e-408a-9afb-fd837a87cec4 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.024327 May 19 12:30:59.275453 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 411/787] 10.222.0.57 () {62 vars in 1187 bytes} [Thu May 19 12:30:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 19 12:30:59.286633 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-368a966d-4fd8-4bbc-b43b-b87a8b71b6e0 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:59.287246 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-368a966d-4fd8-4bbc-b43b-b87a8b71b6e0 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:59.291757 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:59.292978 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:59.320354 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-08218424-3cac-4562-bc44-e179fe120b40 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:59.323365 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-08218424-3cac-4562-bc44-e179fe120b40 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:59.328404 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-08218424-3cac-4562-bc44-e179fe120b40 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:59.329103 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-08218424-3cac-4562-bc44-e179fe120b40 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:59.329882 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-08218424-3cac-4562-bc44-e179fe120b40 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:59.331148 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-08218424-3cac-4562-bc44-e179fe120b40 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:59.334118 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:59.352164 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-368a966d-4fd8-4bbc-b43b-b87a8b71b6e0 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:59.361354 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-368a966d-4fd8-4bbc-b43b-b87a8b71b6e0 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:59.373316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-368a966d-4fd8-4bbc-b43b-b87a8b71b6e0 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:59.373316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-368a966d-4fd8-4bbc-b43b-b87a8b71b6e0 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1282 microversion: 2.20 time: 0.082112 May 19 12:30:59.373316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 377/788] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:30:59 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1282 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:30:59.578872 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-08218424-3cac-4562-bc44-e179fe120b40 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lazy-loading 'services' on Instance uuid f7fd7551-12f3-4549-9429-3a9ecd8dd150 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:30:59.594353 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a6ed7223-3830-480a-be0f-b8e25848b3d3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:59.596961 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a6ed7223-3830-480a-be0f-b8e25848b3d3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:59.603939 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a6ed7223-3830-480a-be0f-b8e25848b3d3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:59.604385 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a6ed7223-3830-480a-be0f-b8e25848b3d3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:59.605154 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a6ed7223-3830-480a-be0f-b8e25848b3d3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:59.605588 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a6ed7223-3830-480a-be0f-b8e25848b3d3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:59.765130 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a6ed7223-3830-480a-be0f-b8e25848b3d3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:30:59.765130 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a6ed7223-3830-480a-be0f-b8e25848b3d3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1367 microversion: 2.1 time: 0.164945 May 19 12:30:59.765130 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 378/789] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:30:59 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:30:59.874884 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-08218424-3cac-4562-bc44-e179fe120b40 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments/83448f12-3782-486d-ae40-774051e1ae8f" status: 202 len: 0 microversion: 2.1 time: 0.558171 May 19 12:30:59.875547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 412/790] 10.222.0.57 () {58 vars in 1415 bytes} [Thu May 19 12:30:59 2022] DELETE /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments/83448f12-3782-486d-ae40-774051e1ae8f => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:30:59.884397 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-645fe847-6f66-49e4-bbba-0ff456b0b918 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:30:59.885359 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-645fe847-6f66-49e4-bbba-0ff456b0b918 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:30:59.897416 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-645fe847-6f66-49e4-bbba-0ff456b0b918 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:59.897416 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-645fe847-6f66-49e4-bbba-0ff456b0b918 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:59.897416 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-645fe847-6f66-49e4-bbba-0ff456b0b918 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:30:59.897416 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-645fe847-6f66-49e4-bbba-0ff456b0b918 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:30:59.921311 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:30:59.926517 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-645fe847-6f66-49e4-bbba-0ff456b0b918 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046361 May 19 12:30:59.927124 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 379/791] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:30:59 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:00.386006 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-199a4f4b-b5eb-4252-950b-2a08667c37a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:00.386709 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-199a4f4b-b5eb-4252-950b-2a08667c37a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:00.392958 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-199a4f4b-b5eb-4252-950b-2a08667c37a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:00.393375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-199a4f4b-b5eb-4252-950b-2a08667c37a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:00.394126 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-199a4f4b-b5eb-4252-950b-2a08667c37a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:00.394666 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-199a4f4b-b5eb-4252-950b-2a08667c37a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:00.456243 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-199a4f4b-b5eb-4252-950b-2a08667c37a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:00.463992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-199a4f4b-b5eb-4252-950b-2a08667c37a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:00.465462 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-199a4f4b-b5eb-4252-950b-2a08667c37a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:00.466584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-199a4f4b-b5eb-4252-950b-2a08667c37a1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1286 microversion: 2.20 time: 0.084828 May 19 12:31:00.467125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 413/792] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:00 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:31:00.772885 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a4c73070-2728-494b-bde2-ead79e4754b7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:00.773612 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a4c73070-2728-494b-bde2-ead79e4754b7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:00.781058 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a4c73070-2728-494b-bde2-ead79e4754b7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:00.781506 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a4c73070-2728-494b-bde2-ead79e4754b7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:00.782308 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a4c73070-2728-494b-bde2-ead79e4754b7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:00.782824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a4c73070-2728-494b-bde2-ead79e4754b7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:00.921140 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a4c73070-2728-494b-bde2-ead79e4754b7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:00.929639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a4c73070-2728-494b-bde2-ead79e4754b7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1367 microversion: 2.1 time: 0.161471 May 19 12:31:00.930216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 380/793] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:00 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:00.938518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4f6daa2c-1425-457f-9caa-1d7a569d03ec tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:00.939502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4f6daa2c-1425-457f-9caa-1d7a569d03ec tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:00.946204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4f6daa2c-1425-457f-9caa-1d7a569d03ec tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:00.946715 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4f6daa2c-1425-457f-9caa-1d7a569d03ec tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:00.947470 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4f6daa2c-1425-457f-9caa-1d7a569d03ec tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:00.947898 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4f6daa2c-1425-457f-9caa-1d7a569d03ec tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:00.978916 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4f6daa2c-1425-457f-9caa-1d7a569d03ec tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 May 19 12:31:00.979459 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 414/794] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:31:00 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:01.484545 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-40ab7932-3f24-4363-b955-0b4df8395a12 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:01.485161 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-40ab7932-3f24-4363-b955-0b4df8395a12 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:01.495402 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40ab7932-3f24-4363-b955-0b4df8395a12 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:01.496001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40ab7932-3f24-4363-b955-0b4df8395a12 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:01.496789 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40ab7932-3f24-4363-b955-0b4df8395a12 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:01.497226 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40ab7932-3f24-4363-b955-0b4df8395a12 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:01.560795 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-40ab7932-3f24-4363-b955-0b4df8395a12 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:01.571105 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-40ab7932-3f24-4363-b955-0b4df8395a12 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:01.572590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-40ab7932-3f24-4363-b955-0b4df8395a12 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:01.574385 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-40ab7932-3f24-4363-b955-0b4df8395a12 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1286 microversion: 2.20 time: 0.093340 May 19 12:31:01.574987 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 381/795] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:01 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:31:01.947229 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fe4604ed-fe81-49b2-81e5-52281b034a33 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:01.947836 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fe4604ed-fe81-49b2-81e5-52281b034a33 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:01.954572 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe4604ed-fe81-49b2-81e5-52281b034a33 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:01.955022 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe4604ed-fe81-49b2-81e5-52281b034a33 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:01.955795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe4604ed-fe81-49b2-81e5-52281b034a33 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:01.956795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe4604ed-fe81-49b2-81e5-52281b034a33 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:01.990583 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dcd82f88-1b01-48fd-979b-aaa2858ffbf0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:01.991805 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dcd82f88-1b01-48fd-979b-aaa2858ffbf0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:01.999030 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dcd82f88-1b01-48fd-979b-aaa2858ffbf0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:01.999485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dcd82f88-1b01-48fd-979b-aaa2858ffbf0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:02.000794 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dcd82f88-1b01-48fd-979b-aaa2858ffbf0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:02.000794 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dcd82f88-1b01-48fd-979b-aaa2858ffbf0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:02.037100 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dcd82f88-1b01-48fd-979b-aaa2858ffbf0 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049946 May 19 12:31:02.037703 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 382/796] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:31:01 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:31:02.116471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fe4604ed-fe81-49b2-81e5-52281b034a33 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:02.124955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fe4604ed-fe81-49b2-81e5-52281b034a33 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1367 microversion: 2.1 time: 0.181430 May 19 12:31:02.125548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 415/797] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:01 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:02.593812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bcc292ff-1c2e-4eb9-8574-ebc399126a65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:02.594542 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bcc292ff-1c2e-4eb9-8574-ebc399126a65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:02.601859 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bcc292ff-1c2e-4eb9-8574-ebc399126a65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:02.602684 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bcc292ff-1c2e-4eb9-8574-ebc399126a65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:02.603452 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bcc292ff-1c2e-4eb9-8574-ebc399126a65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:02.603883 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bcc292ff-1c2e-4eb9-8574-ebc399126a65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:02.672090 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bcc292ff-1c2e-4eb9-8574-ebc399126a65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:02.681674 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bcc292ff-1c2e-4eb9-8574-ebc399126a65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:02.683194 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bcc292ff-1c2e-4eb9-8574-ebc399126a65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:02.684330 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bcc292ff-1c2e-4eb9-8574-ebc399126a65 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1334 microversion: 2.20 time: 0.095231 May 19 12:31:02.684879 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 383/798] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:02 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:31:03.049313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ff849b51-92a9-4538-8e2c-718a77c0ca4c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:03.052043 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ff849b51-92a9-4538-8e2c-718a77c0ca4c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:03.058495 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ff849b51-92a9-4538-8e2c-718a77c0ca4c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:03.059253 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ff849b51-92a9-4538-8e2c-718a77c0ca4c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:03.060041 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ff849b51-92a9-4538-8e2c-718a77c0ca4c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:03.060632 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ff849b51-92a9-4538-8e2c-718a77c0ca4c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:03.094537 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ff849b51-92a9-4538-8e2c-718a77c0ca4c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049298 May 19 12:31:03.095125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 416/799] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:31:03 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:31:03.142908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e45228dd-12b2-406d-b788-64908c54f857 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:03.143638 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e45228dd-12b2-406d-b788-64908c54f857 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:03.150809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e45228dd-12b2-406d-b788-64908c54f857 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:03.151363 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e45228dd-12b2-406d-b788-64908c54f857 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:03.152210 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e45228dd-12b2-406d-b788-64908c54f857 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:03.152660 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e45228dd-12b2-406d-b788-64908c54f857 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:03.172040 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-bedcba1c-6047-459d-8ca0-f8a894ef846f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:03.172529 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-bedcba1c-6047-459d-8ca0-f8a894ef846f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:03.181572 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bedcba1c-6047-459d-8ca0-f8a894ef846f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:03.185778 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bedcba1c-6047-459d-8ca0-f8a894ef846f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:03.185778 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bedcba1c-6047-459d-8ca0-f8a894ef846f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:03.185778 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bedcba1c-6047-459d-8ca0-f8a894ef846f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:03.218953 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-bedcba1c-6047-459d-8ca0-f8a894ef846f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Going to try to terminate instance {{(pid=118112) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:31:03.342706 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e45228dd-12b2-406d-b788-64908c54f857 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:03.351403 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e45228dd-12b2-406d-b788-64908c54f857 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1367 microversion: 2.1 time: 0.212742 May 19 12:31:03.351977 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 384/800] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:03 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:03.600853 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-bedcba1c-6047-459d-8ca0-f8a894ef846f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 204 len: 0 microversion: 2.1 time: 0.432370 May 19 12:31:03.601577 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 417/801] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:31:03 2022] DELETE /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 12:31:03.610072 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-679ec745-9541-41cd-965e-93a24f16479e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:03.610812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-679ec745-9541-41cd-965e-93a24f16479e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:03.617318 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-679ec745-9541-41cd-965e-93a24f16479e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:03.617765 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-679ec745-9541-41cd-965e-93a24f16479e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:03.618640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-679ec745-9541-41cd-965e-93a24f16479e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:03.619074 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-679ec745-9541-41cd-965e-93a24f16479e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:03.704748 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1c73c4bb-4af2-4b49-8d2f-bcf1179b4ade tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:03.705578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1c73c4bb-4af2-4b49-8d2f-bcf1179b4ade tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:03.712876 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1c73c4bb-4af2-4b49-8d2f-bcf1179b4ade tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:03.713424 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1c73c4bb-4af2-4b49-8d2f-bcf1179b4ade tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:03.714266 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1c73c4bb-4af2-4b49-8d2f-bcf1179b4ade tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:03.714796 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1c73c4bb-4af2-4b49-8d2f-bcf1179b4ade tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:03.807251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1c73c4bb-4af2-4b49-8d2f-bcf1179b4ade tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:03.815556 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1c73c4bb-4af2-4b49-8d2f-bcf1179b4ade tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:03.817789 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1c73c4bb-4af2-4b49-8d2f-bcf1179b4ade tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:03.819043 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1c73c4bb-4af2-4b49-8d2f-bcf1179b4ade tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1340 microversion: 2.20 time: 0.120502 May 19 12:31:03.819604 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 418/802] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:03 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1340 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:31:03.846374 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-679ec745-9541-41cd-965e-93a24f16479e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:03.854538 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-679ec745-9541-41cd-965e-93a24f16479e tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1689 microversion: 2.1 time: 0.248482 May 19 12:31:03.855112 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 385/803] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:03 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1689 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:04.368862 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d759d8d8-7483-4354-8e1f-fa06ca10096f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:04.369614 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d759d8d8-7483-4354-8e1f-fa06ca10096f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:04.376147 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d759d8d8-7483-4354-8e1f-fa06ca10096f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:04.376601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d759d8d8-7483-4354-8e1f-fa06ca10096f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:04.377365 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d759d8d8-7483-4354-8e1f-fa06ca10096f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:04.377800 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d759d8d8-7483-4354-8e1f-fa06ca10096f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:04.403306 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-8a8297de-b23b-4233-b5dc-3479a6e266f9 req-61f2d16f-12e3-4ad9-8d0c-62749b8232e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd02616-e81f-4372-89c1-8a9f63588512", "name": "network-vif-plugged", "status": "completed", "tag": "b000d5e8-7d43-43d1-b1d5-88228f892e8f"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:04.416315 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-8a8297de-b23b-4233-b5dc-3479a6e266f9 req-61f2d16f-12e3-4ad9-8d0c-62749b8232e4 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:04.416764 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-8a8297de-b23b-4233-b5dc-3479a6e266f9 req-61f2d16f-12e3-4ad9-8d0c-62749b8232e4 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:04.430618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-8a8297de-b23b-4233-b5dc-3479a6e266f9 req-61f2d16f-12e3-4ad9-8d0c-62749b8232e4 service nova] Creating event network-vif-plugged:b000d5e8-7d43-43d1-b1d5-88228f892e8f for instance 5bd02616-e81f-4372-89c1-8a9f63588512 on hv-cinder-77819 May 19 12:31:04.437122 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-8a8297de-b23b-4233-b5dc-3479a6e266f9 req-61f2d16f-12e3-4ad9-8d0c-62749b8232e4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096362 May 19 12:31:04.437735 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 419/804] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:31:04.530878 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d759d8d8-7483-4354-8e1f-fa06ca10096f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:04.530878 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d759d8d8-7483-4354-8e1f-fa06ca10096f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1367 microversion: 2.1 time: 0.164120 May 19 12:31:04.530878 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 386/805] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:04 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:04.838638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d37385e7-23b8-41b9-9933-3529db7b769e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:04.839329 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d37385e7-23b8-41b9-9933-3529db7b769e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:04.845924 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d37385e7-23b8-41b9-9933-3529db7b769e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:04.846370 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d37385e7-23b8-41b9-9933-3529db7b769e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:04.848000 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d37385e7-23b8-41b9-9933-3529db7b769e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:04.848682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d37385e7-23b8-41b9-9933-3529db7b769e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:04.871686 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a187a8ba-429e-4f20-9194-a977e99afda6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:04.872300 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a187a8ba-429e-4f20-9194-a977e99afda6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:04.878586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a187a8ba-429e-4f20-9194-a977e99afda6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:04.879044 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a187a8ba-429e-4f20-9194-a977e99afda6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:04.879814 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a187a8ba-429e-4f20-9194-a977e99afda6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:04.880255 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a187a8ba-429e-4f20-9194-a977e99afda6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:05.049505 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d37385e7-23b8-41b9-9933-3529db7b769e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:05.056736 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a187a8ba-429e-4f20-9194-a977e99afda6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:05.058927 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d37385e7-23b8-41b9-9933-3529db7b769e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:05.060511 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d37385e7-23b8-41b9-9933-3529db7b769e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:05.061616 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d37385e7-23b8-41b9-9933-3529db7b769e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1407 microversion: 2.20 time: 0.227393 May 19 12:31:05.062172 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 420/806] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:04 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:31:05.064446 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a187a8ba-429e-4f20-9194-a977e99afda6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1689 microversion: 2.1 time: 0.196550 May 19 12:31:05.065016 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 387/807] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:04 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1689 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:05.548682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e588af46-a6d8-4686-be43-612bfea46464 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:05.549243 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e588af46-a6d8-4686-be43-612bfea46464 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:05.556362 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e588af46-a6d8-4686-be43-612bfea46464 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:05.556821 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e588af46-a6d8-4686-be43-612bfea46464 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:05.557612 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e588af46-a6d8-4686-be43-612bfea46464 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:05.558051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e588af46-a6d8-4686-be43-612bfea46464 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:05.704605 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e588af46-a6d8-4686-be43-612bfea46464 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:05.713202 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e588af46-a6d8-4686-be43-612bfea46464 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1367 microversion: 2.1 time: 0.168844 May 19 12:31:05.713789 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 421/808] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:05 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:06.079130 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5a26b61f-1662-41ab-a8a7-1f068d819254 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:06.079727 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5a26b61f-1662-41ab-a8a7-1f068d819254 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:06.080736 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-eca40a3c-f204-435f-98dc-bd943672059a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:06.081452 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-eca40a3c-f204-435f-98dc-bd943672059a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:06.087306 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5a26b61f-1662-41ab-a8a7-1f068d819254 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:06.087760 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5a26b61f-1662-41ab-a8a7-1f068d819254 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:06.088332 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-eca40a3c-f204-435f-98dc-bd943672059a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:06.088593 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5a26b61f-1662-41ab-a8a7-1f068d819254 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:06.088774 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-eca40a3c-f204-435f-98dc-bd943672059a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:06.089035 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5a26b61f-1662-41ab-a8a7-1f068d819254 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:06.089544 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-eca40a3c-f204-435f-98dc-bd943672059a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:06.089978 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-eca40a3c-f204-435f-98dc-bd943672059a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:06.294723 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5a26b61f-1662-41ab-a8a7-1f068d819254 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:06.298541 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-eca40a3c-f204-435f-98dc-bd943672059a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:06.303979 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5a26b61f-1662-41ab-a8a7-1f068d819254 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:06.305480 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5a26b61f-1662-41ab-a8a7-1f068d819254 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:06.306622 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5a26b61f-1662-41ab-a8a7-1f068d819254 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1407 microversion: 2.20 time: 0.231526 May 19 12:31:06.307072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-eca40a3c-f204-435f-98dc-bd943672059a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1689 microversion: 2.1 time: 0.230012 May 19 12:31:06.307189 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 388/809] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:06 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:31:06.307640 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 422/810] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:06 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1689 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:06.731882 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-00a876f6-9aed-436b-be66-c9b50e4e0d02 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:06.732493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-00a876f6-9aed-436b-be66-c9b50e4e0d02 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:06.739374 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00a876f6-9aed-436b-be66-c9b50e4e0d02 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:06.739822 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00a876f6-9aed-436b-be66-c9b50e4e0d02 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:06.740579 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00a876f6-9aed-436b-be66-c9b50e4e0d02 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:06.741032 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00a876f6-9aed-436b-be66-c9b50e4e0d02 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:06.949173 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-00a876f6-9aed-436b-be66-c9b50e4e0d02 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:06.957779 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-00a876f6-9aed-436b-be66-c9b50e4e0d02 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1367 microversion: 2.1 time: 0.229734 May 19 12:31:06.958339 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 389/811] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:06 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:07.325703 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9175bb2f-86fc-477e-ab0e-a9c92993d9bf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:07.326281 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-45ffcc77-93f0-4014-aea4-dc310dd58f3c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:07.326929 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9175bb2f-86fc-477e-ab0e-a9c92993d9bf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:07.327021 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-45ffcc77-93f0-4014-aea4-dc310dd58f3c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:07.334059 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-45ffcc77-93f0-4014-aea4-dc310dd58f3c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:07.334669 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-45ffcc77-93f0-4014-aea4-dc310dd58f3c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:07.334947 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9175bb2f-86fc-477e-ab0e-a9c92993d9bf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:07.335408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9175bb2f-86fc-477e-ab0e-a9c92993d9bf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:07.335677 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-45ffcc77-93f0-4014-aea4-dc310dd58f3c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:07.336378 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9175bb2f-86fc-477e-ab0e-a9c92993d9bf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:07.336518 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-45ffcc77-93f0-4014-aea4-dc310dd58f3c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:07.336671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9175bb2f-86fc-477e-ab0e-a9c92993d9bf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:07.631099 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9175bb2f-86fc-477e-ab0e-a9c92993d9bf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:07.651150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9175bb2f-86fc-477e-ab0e-a9c92993d9bf tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1689 microversion: 2.1 time: 0.329625 May 19 12:31:07.653730 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-45ffcc77-93f0-4014-aea4-dc310dd58f3c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:07.655049 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 423/812] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:07 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1689 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:07.668741 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-45ffcc77-93f0-4014-aea4-dc310dd58f3c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:07.670708 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-45ffcc77-93f0-4014-aea4-dc310dd58f3c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:07.672035 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-45ffcc77-93f0-4014-aea4-dc310dd58f3c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1407 microversion: 2.20 time: 0.350630 May 19 12:31:07.672681 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 390/813] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:07 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:31:07.872878 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-ef389935-f6c7-4344-a3d5-6d4a48dd4ea9 req-9d1c0cce-3b91-4a1c-8420-c587197781dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "366b434a-af2f-4b06-beda-5bb9b4816e66", "tag": "aa50357b-95ff-4657-bbc2-3b5dd21e899e"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:07.887397 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-ef389935-f6c7-4344-a3d5-6d4a48dd4ea9 req-9d1c0cce-3b91-4a1c-8420-c587197781dc service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:07.887840 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-ef389935-f6c7-4344-a3d5-6d4a48dd4ea9 req-9d1c0cce-3b91-4a1c-8420-c587197781dc service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:07.899647 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-ef389935-f6c7-4344-a3d5-6d4a48dd4ea9 req-9d1c0cce-3b91-4a1c-8420-c587197781dc service nova] Creating event network-changed:aa50357b-95ff-4657-bbc2-3b5dd21e899e for instance 366b434a-af2f-4b06-beda-5bb9b4816e66 on hv-cinder-77819 May 19 12:31:07.905241 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-ef389935-f6c7-4344-a3d5-6d4a48dd4ea9 req-9d1c0cce-3b91-4a1c-8420-c587197781dc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035711 May 19 12:31:07.906331 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 424/814] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:07.977235 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1159d006-e361-47fe-810b-49c84c8fc548 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:07.978333 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1159d006-e361-47fe-810b-49c84c8fc548 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:07.985862 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1159d006-e361-47fe-810b-49c84c8fc548 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:07.986664 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1159d006-e361-47fe-810b-49c84c8fc548 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:07.988715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1159d006-e361-47fe-810b-49c84c8fc548 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:07.989348 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1159d006-e361-47fe-810b-49c84c8fc548 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:08.185150 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1159d006-e361-47fe-810b-49c84c8fc548 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:08.199894 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1159d006-e361-47fe-810b-49c84c8fc548 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1367 microversion: 2.1 time: 0.226624 May 19 12:31:08.204226 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 391/815] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:07 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:08.573846 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-60ad9400-57d2-48ff-9046-9810341ca5c6 req-126f2045-bc71-4957-b552-cbb260cef151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7fd7551-12f3-4549-9429-3a9ecd8dd150", "name": "network-vif-deleted", "tag": "849d8b72-d2dd-410e-89b0-e5a60ec6340e"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:08.595361 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-60ad9400-57d2-48ff-9046-9810341ca5c6 req-126f2045-bc71-4957-b552-cbb260cef151 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:08.596149 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-60ad9400-57d2-48ff-9046-9810341ca5c6 req-126f2045-bc71-4957-b552-cbb260cef151 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:08.611573 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-60ad9400-57d2-48ff-9046-9810341ca5c6 req-126f2045-bc71-4957-b552-cbb260cef151 service nova] Creating event network-vif-deleted:849d8b72-d2dd-410e-89b0-e5a60ec6340e for instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 on hv-cinder-77819 May 19 12:31:08.619768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-60ad9400-57d2-48ff-9046-9810341ca5c6 req-126f2045-bc71-4957-b552-cbb260cef151 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118150 May 19 12:31:08.626557 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 425/816] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:08.680711 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b15c24f2-b9b9-496c-9c6c-38367b1e5d7a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:08.682055 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b15c24f2-b9b9-496c-9c6c-38367b1e5d7a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:08.697517 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8544e420-7c8c-455d-8967-205f6caefe48 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:08.698551 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8544e420-7c8c-455d-8967-205f6caefe48 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:08.701738 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b15c24f2-b9b9-496c-9c6c-38367b1e5d7a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:08.703072 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b15c24f2-b9b9-496c-9c6c-38367b1e5d7a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:08.704421 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b15c24f2-b9b9-496c-9c6c-38367b1e5d7a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:08.705599 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b15c24f2-b9b9-496c-9c6c-38367b1e5d7a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:08.713693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8544e420-7c8c-455d-8967-205f6caefe48 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:08.714372 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8544e420-7c8c-455d-8967-205f6caefe48 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:08.715497 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8544e420-7c8c-455d-8967-205f6caefe48 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:08.717966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8544e420-7c8c-455d-8967-205f6caefe48 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:08.816990 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b15c24f2-b9b9-496c-9c6c-38367b1e5d7a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:08.828045 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b15c24f2-b9b9-496c-9c6c-38367b1e5d7a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1622 microversion: 2.1 time: 0.159898 May 19 12:31:08.828991 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 392/817] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:08 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1622 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:08.986581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8544e420-7c8c-455d-8967-205f6caefe48 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:08.996157 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8544e420-7c8c-455d-8967-205f6caefe48 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:08.997661 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8544e420-7c8c-455d-8967-205f6caefe48 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:08.998898 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8544e420-7c8c-455d-8967-205f6caefe48 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1407 microversion: 2.20 time: 0.306006 May 19 12:31:08.999477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 426/818] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:08 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:31:09.214564 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cae034e5-1bbd-4125-ae22-117a85710a2d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:09.215472 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cae034e5-1bbd-4125-ae22-117a85710a2d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:09.223051 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cae034e5-1bbd-4125-ae22-117a85710a2d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:09.223716 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cae034e5-1bbd-4125-ae22-117a85710a2d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:09.224653 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cae034e5-1bbd-4125-ae22-117a85710a2d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:09.225198 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cae034e5-1bbd-4125-ae22-117a85710a2d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:09.356420 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=12 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:09.399130 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cae034e5-1bbd-4125-ae22-117a85710a2d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:09.408028 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cae034e5-1bbd-4125-ae22-117a85710a2d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1367 microversion: 2.1 time: 0.197886 May 19 12:31:09.408622 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 393/819] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:09 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:09.848805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a914a230-7401-486c-b7af-116ffca605bd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:09.849731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a914a230-7401-486c-b7af-116ffca605bd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:09.851632 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:09.852543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=18 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:09.859055 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a914a230-7401-486c-b7af-116ffca605bd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:09.859748 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a914a230-7401-486c-b7af-116ffca605bd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:09.860547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a914a230-7401-486c-b7af-116ffca605bd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:09.860994 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a914a230-7401-486c-b7af-116ffca605bd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:09.900905 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a914a230-7401-486c-b7af-116ffca605bd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:09.902337 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a914a230-7401-486c-b7af-116ffca605bd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:09.902853 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-a914a230-7401-486c-b7af-116ffca605bd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lazy-loading 'fault' on Instance uuid f7fd7551-12f3-4549-9429-3a9ecd8dd150 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:31:09.954238 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a914a230-7401-486c-b7af-116ffca605bd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:09.968175 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a914a230-7401-486c-b7af-116ffca605bd tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 200 len: 1336 microversion: 2.1 time: 0.123601 May 19 12:31:09.969520 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 427/820] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:09 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 1336 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:10.018504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-528f797a-7939-4201-a247-4cb0915ddc32 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:10.020258 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-528f797a-7939-4201-a247-4cb0915ddc32 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:10.027400 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-528f797a-7939-4201-a247-4cb0915ddc32 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:10.027802 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-528f797a-7939-4201-a247-4cb0915ddc32 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:10.028592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-528f797a-7939-4201-a247-4cb0915ddc32 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:10.029882 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-528f797a-7939-4201-a247-4cb0915ddc32 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:10.278446 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-528f797a-7939-4201-a247-4cb0915ddc32 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:10.290287 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-528f797a-7939-4201-a247-4cb0915ddc32 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:10.293598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-528f797a-7939-4201-a247-4cb0915ddc32 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:10.295802 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-528f797a-7939-4201-a247-4cb0915ddc32 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1407 microversion: 2.20 time: 0.280822 May 19 12:31:10.296409 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 394/821] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:10 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:31:10.427038 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5d943cd9-1c26-4a3e-ba1b-8488c53eb8cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:10.427655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5d943cd9-1c26-4a3e-ba1b-8488c53eb8cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:10.434431 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5d943cd9-1c26-4a3e-ba1b-8488c53eb8cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:10.434887 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5d943cd9-1c26-4a3e-ba1b-8488c53eb8cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:10.435656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5d943cd9-1c26-4a3e-ba1b-8488c53eb8cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:10.436093 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5d943cd9-1c26-4a3e-ba1b-8488c53eb8cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:10.440054 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:10.578433 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5d943cd9-1c26-4a3e-ba1b-8488c53eb8cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:10.587925 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5d943cd9-1c26-4a3e-ba1b-8488c53eb8cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1558 microversion: 2.1 time: 0.166480 May 19 12:31:10.588504 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 428/822] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:10 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:10.604452 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3f27d75d-e6e9-4be2-8b4f-ea8c7b3f2d8b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:10.606595 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3f27d75d-e6e9-4be2-8b4f-ea8c7b3f2d8b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:10.611233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3f27d75d-e6e9-4be2-8b4f-ea8c7b3f2d8b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:10.611690 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3f27d75d-e6e9-4be2-8b4f-ea8c7b3f2d8b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:10.612460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3f27d75d-e6e9-4be2-8b4f-ea8c7b3f2d8b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:10.612902 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3f27d75d-e6e9-4be2-8b4f-ea8c7b3f2d8b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:10.691808 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3f27d75d-e6e9-4be2-8b4f-ea8c7b3f2d8b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091298 May 19 12:31:10.692413 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 395/823] 10.222.0.57 () {58 vars in 1274 bytes} [Thu May 19 12:31:10 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:10.988768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0c458ec4-2a37-4309-b45e-2fc5d90ca530 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:10.989604 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0c458ec4-2a37-4309-b45e-2fc5d90ca530 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: f7fd7551-12f3-4549-9429-3a9ecd8dd150] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:10.997712 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0c458ec4-2a37-4309-b45e-2fc5d90ca530 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:10.998257 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0c458ec4-2a37-4309-b45e-2fc5d90ca530 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:10.999185 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0c458ec4-2a37-4309-b45e-2fc5d90ca530 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:10.999699 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0c458ec4-2a37-4309-b45e-2fc5d90ca530 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:11.015320 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-0c458ec4-2a37-4309-b45e-2fc5d90ca530 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] HTTP exception thrown: Instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 could not be found. May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0c458ec4-2a37-4309-b45e-2fc5d90ca530 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Request method failure captured: May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 HTTP/1.1 May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb6x7UOYCybG9-cKm4BV2RSK8mO4iQRuFsCG79T52SfVrJnf6u9-MO1kqqebqKlEz5jWPbyljj0HdBHu4m_dNASD-FoSZU2o4r_16ajVcR7V7lzHTkKXiXAvVeH3F5QXHk3Uva_ii2xPzNguR5JfCHlU4VxOadvL0aWPLAnKNBIeE0 May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: d9e96ed4a3b5430298605d709d353f6e May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:31:11.017119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:31:11.021048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d9e96ed4a3b5430298605d709d353f6e", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:31:11.021048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:31:11.021048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: d9e96ed4a3b5430298605d709d353f6e May 19 12:31:11.021048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:31:11.021048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-ServerRescueNegativeTestJSON-1726578429-project May 19 12:31:11.021048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:31:11.021048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:31:11.021048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 5c35bd3640694b0dbce13c713fd68306 May 19 12:31:11.021048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726578429-project May 19 12:31:11.021048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:31:11.021048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 could not be found. May 19 12:31:11.021048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': 'f7fd7551-12f3-4549-9429-3a9ecd8dd150'} May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 could not be found. May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:31:11.021805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 could not be found. May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 could not be found. May 19 12:31:11.023705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:11.024771 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0c458ec4-2a37-4309-b45e-2fc5d90ca530 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Returning 404 to user: Instance f7fd7551-12f3-4549-9429-3a9ecd8dd150 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:31:11.024771 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0c458ec4-2a37-4309-b45e-2fc5d90ca530 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150" status: 404 len: 111 microversion: 2.1 time: 0.035066 May 19 12:31:11.024771 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 429/824] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:10 2022] GET /compute/v2.1/servers/f7fd7551-12f3-4549-9429-3a9ecd8dd150 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:31:11.028624 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a83cd121-c10f-490a-a242-2bb6c66b6595 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '.version_select at 0x7fd454fef5e0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:11.120744 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a83cd121-c10f-490a-a242-2bb6c66b6595 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1454104303" status: 202 len: 0 microversion: 2.1 time: 0.096488 May 19 12:31:11.121334 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 396/825] 10.222.0.57 () {58 vars in 1220 bytes} [Thu May 19 12:31:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1454104303 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 12:31:11.317243 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9da04efe-b51e-44a9-8ea0-7d8768b7be4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:11.317863 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9da04efe-b51e-44a9-8ea0-7d8768b7be4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:11.324442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9da04efe-b51e-44a9-8ea0-7d8768b7be4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:11.324883 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9da04efe-b51e-44a9-8ea0-7d8768b7be4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:11.325672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9da04efe-b51e-44a9-8ea0-7d8768b7be4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:11.326110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9da04efe-b51e-44a9-8ea0-7d8768b7be4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:11.561851 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9da04efe-b51e-44a9-8ea0-7d8768b7be4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:11.571483 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9da04efe-b51e-44a9-8ea0-7d8768b7be4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:11.573104 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9da04efe-b51e-44a9-8ea0-7d8768b7be4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:11.574180 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9da04efe-b51e-44a9-8ea0-7d8768b7be4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1407 microversion: 2.20 time: 0.262945 May 19 12:31:11.574765 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 430/826] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:11 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1407 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:31:12.082056 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-77199eda-7d63-449e-9bac-13cd6649db76 req-571ded56-b0bf-40f0-9f8d-9008842e1162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd02616-e81f-4372-89c1-8a9f63588512", "tag": "b000d5e8-7d43-43d1-b1d5-88228f892e8f"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:12.092373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-77199eda-7d63-449e-9bac-13cd6649db76 req-571ded56-b0bf-40f0-9f8d-9008842e1162 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:12.093118 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-77199eda-7d63-449e-9bac-13cd6649db76 req-571ded56-b0bf-40f0-9f8d-9008842e1162 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:12.105967 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-77199eda-7d63-449e-9bac-13cd6649db76 req-571ded56-b0bf-40f0-9f8d-9008842e1162 service nova] Creating event network-changed:b000d5e8-7d43-43d1-b1d5-88228f892e8f for instance 5bd02616-e81f-4372-89c1-8a9f63588512 on hv-cinder-77819 May 19 12:31:12.111195 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-77199eda-7d63-449e-9bac-13cd6649db76 req-571ded56-b0bf-40f0-9f8d-9008842e1162 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033339 May 19 12:31:12.114117 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 397/827] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:12.592733 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-000935a6-a847-476b-a466-9d65547f78cc tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:12.593446 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-000935a6-a847-476b-a466-9d65547f78cc tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:12.600997 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-000935a6-a847-476b-a466-9d65547f78cc tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:12.601542 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-000935a6-a847-476b-a466-9d65547f78cc tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:12.602444 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-000935a6-a847-476b-a466-9d65547f78cc tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:12.602950 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-000935a6-a847-476b-a466-9d65547f78cc tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:12.741277 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-000935a6-a847-476b-a466-9d65547f78cc tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:12.750506 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-000935a6-a847-476b-a466-9d65547f78cc tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:12.752340 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-000935a6-a847-476b-a466-9d65547f78cc tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:12.753671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-000935a6-a847-476b-a466-9d65547f78cc tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1407 microversion: 2.20 time: 0.165049 May 19 12:31:12.754358 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 431/828] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:12 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:31:13.774396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5f54b063-8612-47d3-9ab4-d072a442cca3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:13.775110 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5f54b063-8612-47d3-9ab4-d072a442cca3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:13.781401 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5f54b063-8612-47d3-9ab4-d072a442cca3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:13.781845 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5f54b063-8612-47d3-9ab4-d072a442cca3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:13.782633 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5f54b063-8612-47d3-9ab4-d072a442cca3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:13.783084 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5f54b063-8612-47d3-9ab4-d072a442cca3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:13.799056 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:13.923041 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5f54b063-8612-47d3-9ab4-d072a442cca3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:13.931240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5f54b063-8612-47d3-9ab4-d072a442cca3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:13.932801 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5f54b063-8612-47d3-9ab4-d072a442cca3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:13.933959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5f54b063-8612-47d3-9ab4-d072a442cca3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1407 microversion: 2.20 time: 0.165409 May 19 12:31:13.934553 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 398/829] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:13 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:31:14.767489 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-08c8c382-9cc2-498b-aab8-4a7709eccde6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:14.768028 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-08c8c382-9cc2-498b-aab8-4a7709eccde6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:14.775700 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-08c8c382-9cc2-498b-aab8-4a7709eccde6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:14.776234 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-08c8c382-9cc2-498b-aab8-4a7709eccde6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:14.777039 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-08c8c382-9cc2-498b-aab8-4a7709eccde6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:14.777476 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-08c8c382-9cc2-498b-aab8-4a7709eccde6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:14.803968 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-08c8c382-9cc2-498b-aab8-4a7709eccde6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Going to try to terminate instance {{(pid=118112) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:31:14.952181 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-da15aa3f-b6d9-47a3-829b-bbfcea74b330 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:14.952945 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-da15aa3f-b6d9-47a3-829b-bbfcea74b330 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:14.960681 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da15aa3f-b6d9-47a3-829b-bbfcea74b330 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:14.961132 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da15aa3f-b6d9-47a3-829b-bbfcea74b330 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:14.961909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da15aa3f-b6d9-47a3-829b-bbfcea74b330 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:14.962342 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da15aa3f-b6d9-47a3-829b-bbfcea74b330 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:15.127004 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-da15aa3f-b6d9-47a3-829b-bbfcea74b330 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:15.135945 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-da15aa3f-b6d9-47a3-829b-bbfcea74b330 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:15.137474 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-da15aa3f-b6d9-47a3-829b-bbfcea74b330 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:15.138743 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-da15aa3f-b6d9-47a3-829b-bbfcea74b330 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1407 microversion: 2.20 time: 0.190582 May 19 12:31:15.139284 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 399/830] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:14 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:31:15.143254 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-08c8c382-9cc2-498b-aab8-4a7709eccde6 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "DELETE /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 204 len: 0 microversion: 2.1 time: 0.379350 May 19 12:31:15.144786 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 432/831] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:31:14 2022] DELETE /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:31:15.152544 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e65c41dc-f1dd-4928-9a0c-88fc221f650a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:15.153147 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e65c41dc-f1dd-4928-9a0c-88fc221f650a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:15.159584 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e65c41dc-f1dd-4928-9a0c-88fc221f650a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:15.160165 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e65c41dc-f1dd-4928-9a0c-88fc221f650a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:15.160949 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e65c41dc-f1dd-4928-9a0c-88fc221f650a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:15.161425 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e65c41dc-f1dd-4928-9a0c-88fc221f650a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:15.297076 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e65c41dc-f1dd-4928-9a0c-88fc221f650a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:15.302900 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e65c41dc-f1dd-4928-9a0c-88fc221f650a tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1508 microversion: 2.1 time: 0.154136 May 19 12:31:15.303470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 400/832] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:15 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:16.158036 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-15535231-b151-4d5d-9337-933daee9f077 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:16.158776 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-15535231-b151-4d5d-9337-933daee9f077 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:16.166316 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-15535231-b151-4d5d-9337-933daee9f077 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:16.166805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-15535231-b151-4d5d-9337-933daee9f077 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:16.167582 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-15535231-b151-4d5d-9337-933daee9f077 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:16.168020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-15535231-b151-4d5d-9337-933daee9f077 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:16.312476 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-87f05433-94e0-4a40-9f95-e5687880ed4a req-9308dbff-9b9c-4135-b983-ad075bf7a229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366b434a-af2f-4b06-beda-5bb9b4816e66", "name": "network-vif-plugged", "status": "completed", "tag": "aa50357b-95ff-4657-bbc2-3b5dd21e899e"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:16.314049 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-15535231-b151-4d5d-9337-933daee9f077 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:16.325678 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-15535231-b151-4d5d-9337-933daee9f077 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:16.326807 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-87f05433-94e0-4a40-9f95-e5687880ed4a req-9308dbff-9b9c-4135-b983-ad075bf7a229 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:16.327251 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-87f05433-94e0-4a40-9f95-e5687880ed4a req-9308dbff-9b9c-4135-b983-ad075bf7a229 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:16.327367 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-15535231-b151-4d5d-9337-933daee9f077 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:16.328375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-15535231-b151-4d5d-9337-933daee9f077 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1407 microversion: 2.20 time: 0.174875 May 19 12:31:16.329012 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 433/833] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:16 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:31:16.333807 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e020bf44-7b95-4e70-90eb-8033473f0611 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:16.334439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e020bf44-7b95-4e70-90eb-8033473f0611 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:16.340380 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-87f05433-94e0-4a40-9f95-e5687880ed4a req-9308dbff-9b9c-4135-b983-ad075bf7a229 service nova] Creating event network-vif-plugged:aa50357b-95ff-4657-bbc2-3b5dd21e899e for instance 366b434a-af2f-4b06-beda-5bb9b4816e66 on hv-cinder-77819 May 19 12:31:16.340687 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e020bf44-7b95-4e70-90eb-8033473f0611 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:16.341147 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e020bf44-7b95-4e70-90eb-8033473f0611 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:16.342018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e020bf44-7b95-4e70-90eb-8033473f0611 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:16.342494 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e020bf44-7b95-4e70-90eb-8033473f0611 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:16.345538 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-87f05433-94e0-4a40-9f95-e5687880ed4a req-9308dbff-9b9c-4135-b983-ad075bf7a229 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037133 May 19 12:31:16.346136 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 401/834] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:31:16.484142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e020bf44-7b95-4e70-90eb-8033473f0611 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:16.492646 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e020bf44-7b95-4e70-90eb-8033473f0611 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1508 microversion: 2.1 time: 0.162585 May 19 12:31:16.499547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 434/835] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:16 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:17.351231 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-48400706-2654-47cc-a1d3-acc643f4fd86 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:17.352758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-48400706-2654-47cc-a1d3-acc643f4fd86 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:17.361678 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48400706-2654-47cc-a1d3-acc643f4fd86 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:17.363030 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48400706-2654-47cc-a1d3-acc643f4fd86 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:17.364026 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48400706-2654-47cc-a1d3-acc643f4fd86 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:17.364674 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-48400706-2654-47cc-a1d3-acc643f4fd86 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:17.382078 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-c28c3a2f-aa47-4abc-9f83-b7710893658d req-bfc3b746-5dbd-4321-93fa-8c9ba5a2916c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e6669b-4005-4691-9a9e-42cd9f209a44", "name": "network-vif-deleted", "tag": "8d75d107-85c3-4858-8b90-5ba107a81513"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:17.391241 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-c28c3a2f-aa47-4abc-9f83-b7710893658d req-bfc3b746-5dbd-4321-93fa-8c9ba5a2916c service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:17.396053 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-c28c3a2f-aa47-4abc-9f83-b7710893658d req-bfc3b746-5dbd-4321-93fa-8c9ba5a2916c service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:17.407093 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-c28c3a2f-aa47-4abc-9f83-b7710893658d req-bfc3b746-5dbd-4321-93fa-8c9ba5a2916c service nova] Creating event network-vif-deleted:8d75d107-85c3-4858-8b90-5ba107a81513 for instance 99e6669b-4005-4691-9a9e-42cd9f209a44 on hv-cinder-77819 May 19 12:31:17.413250 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-c28c3a2f-aa47-4abc-9f83-b7710893658d req-bfc3b746-5dbd-4321-93fa-8c9ba5a2916c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036018 May 19 12:31:17.413856 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 435/836] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:31:17.510876 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-16fffa1d-cd48-4e7a-ab54-c5f07509e3f4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:17.511915 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-16fffa1d-cd48-4e7a-ab54-c5f07509e3f4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:17.519171 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-48400706-2654-47cc-a1d3-acc643f4fd86 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:17.519807 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-16fffa1d-cd48-4e7a-ab54-c5f07509e3f4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:17.520263 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-16fffa1d-cd48-4e7a-ab54-c5f07509e3f4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:17.521042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-16fffa1d-cd48-4e7a-ab54-c5f07509e3f4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:17.521484 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-16fffa1d-cd48-4e7a-ab54-c5f07509e3f4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:17.528265 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-48400706-2654-47cc-a1d3-acc643f4fd86 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:17.529762 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-48400706-2654-47cc-a1d3-acc643f4fd86 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:17.530929 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-48400706-2654-47cc-a1d3-acc643f4fd86 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1407 microversion: 2.20 time: 0.187312 May 19 12:31:17.531823 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 402/837] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:17 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:31:17.587041 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-16fffa1d-cd48-4e7a-ab54-c5f07509e3f4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:17.595413 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-16fffa1d-cd48-4e7a-ab54-c5f07509e3f4 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1466 microversion: 2.1 time: 0.088950 May 19 12:31:17.596005 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 436/838] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:17 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1466 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:18.551247 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-818a436a-9224-41c1-ba87-e232ed2d34bd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:18.551868 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-818a436a-9224-41c1-ba87-e232ed2d34bd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:18.559207 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-818a436a-9224-41c1-ba87-e232ed2d34bd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:18.559657 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-818a436a-9224-41c1-ba87-e232ed2d34bd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:18.560435 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-818a436a-9224-41c1-ba87-e232ed2d34bd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:18.560868 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-818a436a-9224-41c1-ba87-e232ed2d34bd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:18.615168 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d3d5b08d-aa06-4524-afea-b7a8b26ff736 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:18.616078 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d3d5b08d-aa06-4524-afea-b7a8b26ff736 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:18.623966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3d5b08d-aa06-4524-afea-b7a8b26ff736 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:18.624397 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3d5b08d-aa06-4524-afea-b7a8b26ff736 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:18.625101 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3d5b08d-aa06-4524-afea-b7a8b26ff736 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:18.625545 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3d5b08d-aa06-4524-afea-b7a8b26ff736 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:18.662212 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3d5b08d-aa06-4524-afea-b7a8b26ff736 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:18.662688 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3d5b08d-aa06-4524-afea-b7a8b26ff736 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:18.663148 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-d3d5b08d-aa06-4524-afea-b7a8b26ff736 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lazy-loading 'fault' on Instance uuid 99e6669b-4005-4691-9a9e-42cd9f209a44 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:31:18.715631 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d3d5b08d-aa06-4524-afea-b7a8b26ff736 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:18.724581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d3d5b08d-aa06-4524-afea-b7a8b26ff736 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 200 len: 1312 microversion: 2.1 time: 0.113804 May 19 12:31:18.725179 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 437/839] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:18 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:18.748357 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-818a436a-9224-41c1-ba87-e232ed2d34bd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:18.757839 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-818a436a-9224-41c1-ba87-e232ed2d34bd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:18.759438 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-818a436a-9224-41c1-ba87-e232ed2d34bd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:18.760580 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-818a436a-9224-41c1-ba87-e232ed2d34bd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1407 microversion: 2.20 time: 0.213952 May 19 12:31:18.761138 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 403/840] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:18 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:31:19.742119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-10a86f10-e41d-48c9-b93a-6bdaf2a4d9ff tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:19.742915 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-10a86f10-e41d-48c9-b93a-6bdaf2a4d9ff tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: 99e6669b-4005-4691-9a9e-42cd9f209a44] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:19.749557 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-10a86f10-e41d-48c9-b93a-6bdaf2a4d9ff tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:19.750014 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-10a86f10-e41d-48c9-b93a-6bdaf2a4d9ff tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:19.750829 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-10a86f10-e41d-48c9-b93a-6bdaf2a4d9ff tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:19.751268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-10a86f10-e41d-48c9-b93a-6bdaf2a4d9ff tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:19.765644 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-10a86f10-e41d-48c9-b93a-6bdaf2a4d9ff tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] HTTP exception thrown: Instance 99e6669b-4005-4691-9a9e-42cd9f209a44 could not be found. May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-10a86f10-e41d-48c9-b93a-6bdaf2a4d9ff tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Request method failure captured: May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 HTTP/1.1 May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb6x7UOYCybG9-cKm4BV2RSK8mO4iQRuFsCG79T52SfVrJnf6u9-MO1kqqebqKlEz5jWPbyljj0HdBHu4m_dNASD-FoSZU2o4r_16ajVcR7V7lzHTkKXiXAvVeH3F5QXHk3Uva_ii2xPzNguR5JfCHlU4VxOadvL0aWPLAnKNBIeE0 May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: d9e96ed4a3b5430298605d709d353f6e May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:31:19.767349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:31:19.770166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d9e96ed4a3b5430298605d709d353f6e", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:31:19.770166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:31:19.770166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: d9e96ed4a3b5430298605d709d353f6e May 19 12:31:19.770166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:31:19.770166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-ServerRescueNegativeTestJSON-1726578429-project May 19 12:31:19.770166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:31:19.770166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:31:19.770166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 5c35bd3640694b0dbce13c713fd68306 May 19 12:31:19.770166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726578429-project May 19 12:31:19.770166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:31:19.770166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 99e6669b-4005-4691-9a9e-42cd9f209a44 could not be found. May 19 12:31:19.770166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '99e6669b-4005-4691-9a9e-42cd9f209a44'} May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e6669b-4005-4691-9a9e-42cd9f209a44 could not be found. May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:31:19.771282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e6669b-4005-4691-9a9e-42cd9f209a44 could not be found. May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e6669b-4005-4691-9a9e-42cd9f209a44 could not be found. May 19 12:31:19.772731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:19.774478 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-10a86f10-e41d-48c9-b93a-6bdaf2a4d9ff tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Returning 404 to user: Instance 99e6669b-4005-4691-9a9e-42cd9f209a44 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:31:19.774478 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-10a86f10-e41d-48c9-b93a-6bdaf2a4d9ff tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44" status: 404 len: 111 microversion: 2.1 time: 0.031185 May 19 12:31:19.774478 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 438/841] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:19 2022] GET /compute/v2.1/servers/99e6669b-4005-4691-9a9e-42cd9f209a44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:31:19.778872 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-76a3fe35-1344-4a72-8036-4964adab4333 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:19.779380 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-76a3fe35-1344-4a72-8036-4964adab4333 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:19.779789 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ca37acc1-b863-44de-b456-7b4afc393d9e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:19.780399 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ca37acc1-b863-44de-b456-7b4afc393d9e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:19.786855 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-76a3fe35-1344-4a72-8036-4964adab4333 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:19.787313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-76a3fe35-1344-4a72-8036-4964adab4333 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:19.788104 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-76a3fe35-1344-4a72-8036-4964adab4333 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:19.788545 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-76a3fe35-1344-4a72-8036-4964adab4333 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:19.789225 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca37acc1-b863-44de-b456-7b4afc393d9e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:19.789684 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca37acc1-b863-44de-b456-7b4afc393d9e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:19.790664 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca37acc1-b863-44de-b456-7b4afc393d9e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:19.791121 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca37acc1-b863-44de-b456-7b4afc393d9e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:19.821664 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-76a3fe35-1344-4a72-8036-4964adab4333 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:31:19.947828 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ca37acc1-b863-44de-b456-7b4afc393d9e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:19.956658 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ca37acc1-b863-44de-b456-7b4afc393d9e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:19.961077 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ca37acc1-b863-44de-b456-7b4afc393d9e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:19.961077 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ca37acc1-b863-44de-b456-7b4afc393d9e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1599 microversion: 2.20 time: 0.183339 May 19 12:31:19.968971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 439/842] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:31:19 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1599 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:31:19.983934 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b5685a51-ecc4-4bab-a987-f399cdfd8593 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:19.984419 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b5685a51-ecc4-4bab-a987-f399cdfd8593 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:19.992070 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b5685a51-ecc4-4bab-a987-f399cdfd8593 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:19.995365 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b5685a51-ecc4-4bab-a987-f399cdfd8593 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:19.995365 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b5685a51-ecc4-4bab-a987-f399cdfd8593 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:19.995365 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b5685a51-ecc4-4bab-a987-f399cdfd8593 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:20.101986 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b5685a51-ecc4-4bab-a987-f399cdfd8593 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.122042 May 19 12:31:20.102641 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 440/843] 10.222.0.57 () {60 vars in 1315 bytes} [Thu May 19 12:31:19 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 12:31:20.189145 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-76a3fe35-1344-4a72-8036-4964adab4333 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "DELETE /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 204 len: 0 microversion: 2.1 time: 0.414392 May 19 12:31:20.189850 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 404/844] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:31:19 2022] DELETE /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:31:20.198335 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4fb59e43-3edf-4914-975f-84bee35ba576 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:20.198992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4fb59e43-3edf-4914-975f-84bee35ba576 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:20.205024 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4fb59e43-3edf-4914-975f-84bee35ba576 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:20.205472 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4fb59e43-3edf-4914-975f-84bee35ba576 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:20.206935 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4fb59e43-3edf-4914-975f-84bee35ba576 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:20.207365 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4fb59e43-3edf-4914-975f-84bee35ba576 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:20.445417 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4fb59e43-3edf-4914-975f-84bee35ba576 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:20.457235 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4fb59e43-3edf-4914-975f-84bee35ba576 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.262582 May 19 12:31:20.458029 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 441/845] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:20 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:21.475277 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8c90a0e6-7dfd-405e-88ab-07b79251b1e1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:21.476117 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-5edbc36c-5d6b-4c94-89be-40018c7a9685 req-1a636342-a619-4df9-b558-c59875bcbb0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "366b434a-af2f-4b06-beda-5bb9b4816e66", "tag": "aa50357b-95ff-4657-bbc2-3b5dd21e899e"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:21.476912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8c90a0e6-7dfd-405e-88ab-07b79251b1e1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:21.482841 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8c90a0e6-7dfd-405e-88ab-07b79251b1e1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:21.483294 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8c90a0e6-7dfd-405e-88ab-07b79251b1e1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:21.484067 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8c90a0e6-7dfd-405e-88ab-07b79251b1e1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:21.484498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8c90a0e6-7dfd-405e-88ab-07b79251b1e1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:21.485408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-5edbc36c-5d6b-4c94-89be-40018c7a9685 req-1a636342-a619-4df9-b558-c59875bcbb0c service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:21.486000 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-5edbc36c-5d6b-4c94-89be-40018c7a9685 req-1a636342-a619-4df9-b558-c59875bcbb0c service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:21.499006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-5edbc36c-5d6b-4c94-89be-40018c7a9685 req-1a636342-a619-4df9-b558-c59875bcbb0c service nova] Creating event network-changed:aa50357b-95ff-4657-bbc2-3b5dd21e899e for instance 366b434a-af2f-4b06-beda-5bb9b4816e66 on hv-cinder-77819 May 19 12:31:21.504969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-5edbc36c-5d6b-4c94-89be-40018c7a9685 req-1a636342-a619-4df9-b558-c59875bcbb0c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035087 May 19 12:31:21.505588 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 405/846] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:21.627185 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8c90a0e6-7dfd-405e-88ab-07b79251b1e1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:21.635766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8c90a0e6-7dfd-405e-88ab-07b79251b1e1 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.165352 May 19 12:31:21.636352 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 442/847] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:21 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:22.654477 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-42f9c9b0-726d-43df-b857-585e282b455f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:22.655509 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-42f9c9b0-726d-43df-b857-585e282b455f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:22.663092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-42f9c9b0-726d-43df-b857-585e282b455f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:22.663548 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-42f9c9b0-726d-43df-b857-585e282b455f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:22.664337 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-42f9c9b0-726d-43df-b857-585e282b455f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:22.664775 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-42f9c9b0-726d-43df-b857-585e282b455f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:22.817555 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-42f9c9b0-726d-43df-b857-585e282b455f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:22.825800 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-42f9c9b0-726d-43df-b857-585e282b455f tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1522 microversion: 2.1 time: 0.175718 May 19 12:31:22.826384 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 406/848] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:22 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:23.706302 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-95cc90ec-f41f-499f-8594-957e213c7637 req-3eb0c78e-a695-4300-a277-ba5d5095aaa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5b2145b-8dcb-4d81-af12-42d1494da298", "name": "network-vif-deleted", "tag": "ead40d23-6a23-4073-ba08-29726edb0ac8"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:23.714902 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-95cc90ec-f41f-499f-8594-957e213c7637 req-3eb0c78e-a695-4300-a277-ba5d5095aaa7 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:23.715347 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-95cc90ec-f41f-499f-8594-957e213c7637 req-3eb0c78e-a695-4300-a277-ba5d5095aaa7 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:23.728237 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-95cc90ec-f41f-499f-8594-957e213c7637 req-3eb0c78e-a695-4300-a277-ba5d5095aaa7 service nova] Creating event network-vif-deleted:ead40d23-6a23-4073-ba08-29726edb0ac8 for instance d5b2145b-8dcb-4d81-af12-42d1494da298 on hv-cinder-77819 May 19 12:31:23.733132 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-95cc90ec-f41f-499f-8594-957e213c7637 req-3eb0c78e-a695-4300-a277-ba5d5095aaa7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031610 May 19 12:31:23.733727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 443/849] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:23.844376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d3eeb0b3-3e09-4664-bc9c-4ed57c279d3c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:23.844986 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d3eeb0b3-3e09-4664-bc9c-4ed57c279d3c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:23.852596 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3eeb0b3-3e09-4664-bc9c-4ed57c279d3c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:23.853044 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3eeb0b3-3e09-4664-bc9c-4ed57c279d3c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:23.853812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3eeb0b3-3e09-4664-bc9c-4ed57c279d3c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:23.854247 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3eeb0b3-3e09-4664-bc9c-4ed57c279d3c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:23.920470 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d3eeb0b3-3e09-4664-bc9c-4ed57c279d3c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c35bd3640694b0dbce13c713fd68306', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e96ed4a3b5430298605d709d353f6e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:23.928664 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d3eeb0b3-3e09-4664-bc9c-4ed57c279d3c tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 200 len: 1307 microversion: 2.1 time: 0.088165 May 19 12:31:23.929504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 407/850] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:23 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:24.947928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b128c9de-c5c4-4ee5-9a65-218d29e9b480 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:24.948985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b128c9de-c5c4-4ee5-9a65-218d29e9b480 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] [instance: d5b2145b-8dcb-4d81-af12-42d1494da298] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:24.956031 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b128c9de-c5c4-4ee5-9a65-218d29e9b480 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:24.956536 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b128c9de-c5c4-4ee5-9a65-218d29e9b480 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:24.957589 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b128c9de-c5c4-4ee5-9a65-218d29e9b480 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:24.958111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b128c9de-c5c4-4ee5-9a65-218d29e9b480 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:24.973124 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-b128c9de-c5c4-4ee5-9a65-218d29e9b480 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] HTTP exception thrown: Instance d5b2145b-8dcb-4d81-af12-42d1494da298 could not be found. May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b128c9de-c5c4-4ee5-9a65-218d29e9b480 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Request method failure captured: May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 HTTP/1.1 May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb6x7UOYCybG9-cKm4BV2RSK8mO4iQRuFsCG79T52SfVrJnf6u9-MO1kqqebqKlEz5jWPbyljj0HdBHu4m_dNASD-FoSZU2o4r_16ajVcR7V7lzHTkKXiXAvVeH3F5QXHk3Uva_ii2xPzNguR5JfCHlU4VxOadvL0aWPLAnKNBIeE0 May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: d9e96ed4a3b5430298605d709d353f6e May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:31:24.974867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:31:24.976223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d9e96ed4a3b5430298605d709d353f6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d9e96ed4a3b5430298605d709d353f6e", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:31:24.976223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:31:24.976223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: d9e96ed4a3b5430298605d709d353f6e May 19 12:31:24.976223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1726578429 May 19 12:31:24.976223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-ServerRescueNegativeTestJSON-1726578429-project May 19 12:31:24.976223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:31:24.976223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:31:24.976223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 5c35bd3640694b0dbce13c713fd68306 May 19 12:31:24.976223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1726578429-project May 19 12:31:24.976223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:31:24.976223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance d5b2145b-8dcb-4d81-af12-42d1494da298 could not be found. May 19 12:31:24.976223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': 'd5b2145b-8dcb-4d81-af12-42d1494da298'} May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5b2145b-8dcb-4d81-af12-42d1494da298 could not be found. May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:31:24.976963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5b2145b-8dcb-4d81-af12-42d1494da298 could not be found. May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5b2145b-8dcb-4d81-af12-42d1494da298 could not be found. May 19 12:31:24.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:24.979294 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b128c9de-c5c4-4ee5-9a65-218d29e9b480 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] Returning 404 to user: Instance d5b2145b-8dcb-4d81-af12-42d1494da298 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:31:24.979294 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b128c9de-c5c4-4ee5-9a65-218d29e9b480 tempest-ServerRescueNegativeTestJSON-1726578429 tempest-ServerRescueNegativeTestJSON-1726578429-project] 10.222.0.57 "GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298" status: 404 len: 111 microversion: 2.1 time: 0.033986 May 19 12:31:24.979294 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 444/851] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:24 2022] GET /compute/v2.1/servers/d5b2145b-8dcb-4d81-af12-42d1494da298 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:31:25.294532 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-55968d9f-a0dd-49c5-b37f-48a1e4d49bac tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1576727543"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:25.294995 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-55968d9f-a0dd-49c5-b37f-48a1e4d49bac tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:25.302709 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-55968d9f-a0dd-49c5-b37f-48a1e4d49bac tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:25.303162 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-55968d9f-a0dd-49c5-b37f-48a1e4d49bac tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:25.304209 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-55968d9f-a0dd-49c5-b37f-48a1e4d49bac tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:25.304636 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-55968d9f-a0dd-49c5-b37f-48a1e4d49bac tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:25.452508 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.network.security_group_api [None req-55968d9f-a0dd-49c5-b37f-48a1e4d49bac tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Removing security group f3c5ed84-35fd-4b71-a298-bf783933d458 from port d7221580-bd77-42eb-a222-b1dd8a491c4c May 19 12:31:25.969856 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-55968d9f-a0dd-49c5-b37f-48a1e4d49bac tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "POST /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/action" status: 202 len: 0 microversion: 2.1 time: 0.678556 May 19 12:31:25.973468 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 408/852] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:31:25 2022] POST /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:31:25.981483 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-d5745ee6-5f79-4435-96c6-1418f71688c9 req-14fc83e2-f53b-490a-a056-07a8e723f530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70659f4e-c927-47dc-a23a-abd0db258731", "tag": "d7221580-bd77-42eb-a222-b1dd8a491c4c"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:25.992785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:26.022913 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-d5745ee6-5f79-4435-96c6-1418f71688c9 req-14fc83e2-f53b-490a-a056-07a8e723f530 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:26.023387 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-d5745ee6-5f79-4435-96c6-1418f71688c9 req-14fc83e2-f53b-490a-a056-07a8e723f530 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:26.049588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-d5745ee6-5f79-4435-96c6-1418f71688c9 req-14fc83e2-f53b-490a-a056-07a8e723f530 service nova] Creating event network-changed:d7221580-bd77-42eb-a222-b1dd8a491c4c for instance 70659f4e-c927-47dc-a23a-abd0db258731 on hv-cinder-77819 May 19 12:31:26.060588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-d5745ee6-5f79-4435-96c6-1418f71688c9 req-14fc83e2-f53b-490a-a056-07a8e723f530 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085517 May 19 12:31:26.062361 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 445/853] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:28.153172 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-4f4f47d5-9565-4305-bf94-d6620247c96c req-b75c8bc8-e3d0-4e1c-81e2-e397744c2b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70659f4e-c927-47dc-a23a-abd0db258731", "tag": "d7221580-bd77-42eb-a222-b1dd8a491c4c"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:28.161584 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2a3a01ae-1629-420d-bc4a-045e234ca792 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:28.167646 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2a3a01ae-1629-420d-bc4a-045e234ca792 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:28.181965 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2a3a01ae-1629-420d-bc4a-045e234ca792 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:28.183450 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-4f4f47d5-9565-4305-bf94-d6620247c96c req-b75c8bc8-e3d0-4e1c-81e2-e397744c2b9d service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:28.184143 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2a3a01ae-1629-420d-bc4a-045e234ca792 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:28.186796 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-4f4f47d5-9565-4305-bf94-d6620247c96c req-b75c8bc8-e3d0-4e1c-81e2-e397744c2b9d service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:28.188064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2a3a01ae-1629-420d-bc4a-045e234ca792 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:28.188719 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2a3a01ae-1629-420d-bc4a-045e234ca792 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:28.216154 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-4f4f47d5-9565-4305-bf94-d6620247c96c req-b75c8bc8-e3d0-4e1c-81e2-e397744c2b9d service nova] Creating event network-changed:d7221580-bd77-42eb-a222-b1dd8a491c4c for instance 70659f4e-c927-47dc-a23a-abd0db258731 on hv-cinder-77819 May 19 12:31:28.230951 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-4f4f47d5-9565-4305-bf94-d6620247c96c req-b75c8bc8-e3d0-4e1c-81e2-e397744c2b9d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080701 May 19 12:31:28.232292 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 446/854] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:28.343173 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-2a3a01ae-1629-420d-bc4a-045e234ca792 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lazy-loading 'services' on Instance uuid 70659f4e-c927-47dc-a23a-abd0db258731 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:31:28.638521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2a3a01ae-1629-420d-bc4a-045e234ca792 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "DELETE /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/os-volume_attachments/7a2e6a4a-7533-466e-81a5-fe22e66e23dd" status: 202 len: 0 microversion: 2.1 time: 0.496307 May 19 12:31:28.643046 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 409/855] 10.222.0.57 () {58 vars in 1415 bytes} [Thu May 19 12:31:28 2022] DELETE /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/os-volume_attachments/7a2e6a4a-7533-466e-81a5-fe22e66e23dd => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:31:28.651867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-35c09605-6e99-4323-b2d2-ef92758ec3f7 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:28.653366 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-35c09605-6e99-4323-b2d2-ef92758ec3f7 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:28.673993 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-35c09605-6e99-4323-b2d2-ef92758ec3f7 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:28.674771 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-35c09605-6e99-4323-b2d2-ef92758ec3f7 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:28.675791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-35c09605-6e99-4323-b2d2-ef92758ec3f7 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:28.676958 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-35c09605-6e99-4323-b2d2-ef92758ec3f7 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:28.731728 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a513764e-a4d1-4c40-a82a-2c4b6f7d3233 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:28.733447 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a513764e-a4d1-4c40-a82a-2c4b6f7d3233 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:28.743587 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a513764e-a4d1-4c40-a82a-2c4b6f7d3233 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:28.744921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a513764e-a4d1-4c40-a82a-2c4b6f7d3233 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:28.746390 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a513764e-a4d1-4c40-a82a-2c4b6f7d3233 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:28.746874 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a513764e-a4d1-4c40-a82a-2c4b6f7d3233 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:28.747419 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:28.756235 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-35c09605-6e99-4323-b2d2-ef92758ec3f7 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111010 May 19 12:31:28.759665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 447/856] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:31:28 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:31:28.791081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a513764e-a4d1-4c40-a82a-2c4b6f7d3233 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070510 May 19 12:31:28.792635 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 410/857] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:31:28 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:31:28.865047 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5086b92d-37cd-437c-90c9-3d58f5693265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:28.865686 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5086b92d-37cd-437c-90c9-3d58f5693265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:28.875711 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5086b92d-37cd-437c-90c9-3d58f5693265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:28.876170 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5086b92d-37cd-437c-90c9-3d58f5693265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:28.877218 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5086b92d-37cd-437c-90c9-3d58f5693265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:28.877944 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5086b92d-37cd-437c-90c9-3d58f5693265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:28.905134 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5086b92d-37cd-437c-90c9-3d58f5693265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Going to try to terminate instance {{(pid=118112) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:31:29.322251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5086b92d-37cd-437c-90c9-3d58f5693265 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 204 len: 0 microversion: 2.1 time: 0.461407 May 19 12:31:29.330518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 448/858] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:31:28 2022] DELETE /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:31:29.332249 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-127035ad-1003-4b03-a16d-83e892ebe1fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:29.332886 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-127035ad-1003-4b03-a16d-83e892ebe1fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:29.339679 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-127035ad-1003-4b03-a16d-83e892ebe1fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:29.340499 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-127035ad-1003-4b03-a16d-83e892ebe1fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:29.341526 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-127035ad-1003-4b03-a16d-83e892ebe1fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:29.342127 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-127035ad-1003-4b03-a16d-83e892ebe1fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:29.492102 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-127035ad-1003-4b03-a16d-83e892ebe1fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:29.499802 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-127035ad-1003-4b03-a16d-83e892ebe1fb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1671 microversion: 2.1 time: 0.172602 May 19 12:31:29.500379 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 411/859] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:29 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:29.771936 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0dbd6243-a28a-40fd-b784-3d980ba4de2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:29.773217 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0dbd6243-a28a-40fd-b784-3d980ba4de2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:29.780052 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0dbd6243-a28a-40fd-b784-3d980ba4de2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:29.780495 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0dbd6243-a28a-40fd-b784-3d980ba4de2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:29.781267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0dbd6243-a28a-40fd-b784-3d980ba4de2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:29.781704 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0dbd6243-a28a-40fd-b784-3d980ba4de2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:29.814291 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0dbd6243-a28a-40fd-b784-3d980ba4de2d tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047476 May 19 12:31:29.818907 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 449/860] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:31:29 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:30.517198 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8968cf56-9aa3-4147-b900-e6adef7b558a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:30.517815 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8968cf56-9aa3-4147-b900-e6adef7b558a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:30.525414 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8968cf56-9aa3-4147-b900-e6adef7b558a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:30.525867 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8968cf56-9aa3-4147-b900-e6adef7b558a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:30.526675 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8968cf56-9aa3-4147-b900-e6adef7b558a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:30.527118 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8968cf56-9aa3-4147-b900-e6adef7b558a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:30.687562 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8968cf56-9aa3-4147-b900-e6adef7b558a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:30.696975 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8968cf56-9aa3-4147-b900-e6adef7b558a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1671 microversion: 2.1 time: 0.183581 May 19 12:31:30.697612 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 412/861] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:30 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1671 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:30.826548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8858dcd2-0bc5-448e-aa8a-719c4421ee88 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:30.827490 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8858dcd2-0bc5-448e-aa8a-719c4421ee88 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:30.834276 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8858dcd2-0bc5-448e-aa8a-719c4421ee88 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:30.834754 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8858dcd2-0bc5-448e-aa8a-719c4421ee88 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:30.835519 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8858dcd2-0bc5-448e-aa8a-719c4421ee88 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:30.835953 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8858dcd2-0bc5-448e-aa8a-719c4421ee88 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:30.869587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8858dcd2-0bc5-448e-aa8a-719c4421ee88 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046912 May 19 12:31:30.870449 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 450/862] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:31:30 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:31:30.880376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5fbadd59-0b0e-40c4-b630-2b09627b921f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:30.880876 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5fbadd59-0b0e-40c4-b630-2b09627b921f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:30.883200 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:30.887932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5fbadd59-0b0e-40c4-b630-2b09627b921f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:30.888420 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5fbadd59-0b0e-40c4-b630-2b09627b921f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:30.889269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5fbadd59-0b0e-40c4-b630-2b09627b921f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:30.889714 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5fbadd59-0b0e-40c4-b630-2b09627b921f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:30.993233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-5fbadd59-0b0e-40c4-b630-2b09627b921f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] HTTP exception thrown: Instance 70659f4e-c927-47dc-a23a-abd0db258731 is not attached to volume 7a2e6a4a-7533-466e-81a5-fe22e66e23dd May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5fbadd59-0b0e-40c4-b630-2b09627b921f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Request method failure captured: May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/os-volume_attachments/7a2e6a4a-7533-466e-81a5-fe22e66e23dd HTTP/1.1 May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjeT5tlNY6Fs9sruvZrza3x-EVsseUCsu63bmMKuzmHwger7gJ9elbw6P6GsuljE_Koiv-EIC5bqn8LyBL6yNH-R21lhTomn0vA3khn_2Nf6eHf-6uBlBQV_eGyZPV3DejGN_9-_KPzxDcRmS3f6KzjtejRerVODfFa7WrrLeu14Dok May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 3be6c3cdf062493184ab67ec3ec9940f May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-TestMinimumBasicScenario-585859668 May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:31:30.997617 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:31:30.999123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3be6c3cdf062493184ab67ec3ec9940f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3be6c3cdf062493184ab67ec3ec9940f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3be6c3cdf062493184ab67ec3ec9940f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3be6c3cdf062493184ab67ec3ec9940f", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:31:30.999123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-TestMinimumBasicScenario-585859668 May 19 12:31:30.999123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 3be6c3cdf062493184ab67ec3ec9940f May 19 12:31:30.999123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-TestMinimumBasicScenario-585859668 May 19 12:31:30.999123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-TestMinimumBasicScenario-585859668-project May 19 12:31:30.999123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:31:30.999123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:31:30.999123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 3cf7a5b535234632bb00a9b87ceb5354 May 19 12:31:30.999123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-TestMinimumBasicScenario-585859668-project May 19 12:31:30.999123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:31:30.999123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance 70659f4e-c927-47dc-a23a-abd0db258731 is not attached to volume 7a2e6a4a-7533-466e-81a5-fe22e66e23dd May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'server_id': '70659f4e-c927-47dc-a23a-abd0db258731', 'id': '7a2e6a4a-7533-466e-81a5-fe22e66e23dd'} May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7a2e6a4a-7533-466e-81a5-fe22e66e23dd. May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:31:30.999908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70659f4e-c927-47dc-a23a-abd0db258731 is not attached to volume 7a2e6a4a-7533-466e-81a5-fe22e66e23dd May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70659f4e-c927-47dc-a23a-abd0db258731 is not attached to volume 7a2e6a4a-7533-466e-81a5-fe22e66e23dd May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:31:31.001218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5fbadd59-0b0e-40c4-b630-2b09627b921f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Returning 404 to user: Instance 70659f4e-c927-47dc-a23a-abd0db258731 is not attached to volume 7a2e6a4a-7533-466e-81a5-fe22e66e23dd {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:31:31.002659 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5fbadd59-0b0e-40c4-b630-2b09627b921f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "DELETE /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/os-volume_attachments/7a2e6a4a-7533-466e-81a5-fe22e66e23dd" status: 404 len: 154 microversion: 2.1 time: 0.123873 May 19 12:31:31.002659 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 413/863] 10.222.0.57 () {58 vars in 1415 bytes} [Thu May 19 12:31:30 2022] DELETE /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731/os-volume_attachments/7a2e6a4a-7533-466e-81a5-fe22e66e23dd => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:31:31.718152 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1641e21f-a222-4bb2-b011-31f06b47ffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:31.718152 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1641e21f-a222-4bb2-b011-31f06b47ffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:31.722913 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1641e21f-a222-4bb2-b011-31f06b47ffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:31.723375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1641e21f-a222-4bb2-b011-31f06b47ffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:31.724272 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1641e21f-a222-4bb2-b011-31f06b47ffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:31.724716 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1641e21f-a222-4bb2-b011-31f06b47ffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:31.835491 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1641e21f-a222-4bb2-b011-31f06b47ffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:31.843465 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1641e21f-a222-4bb2-b011-31f06b47ffd2 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1603 microversion: 2.1 time: 0.131970 May 19 12:31:31.844058 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 451/864] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:31 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1603 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:32.308371 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-dbddedb9-1645-41b1-9f69-f3496bdc22ea req-2ff70ecb-2403-47af-9142-493c1be53af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1", "name": "network-vif-deleted", "tag": "b53cc247-1a43-4485-97e1-5c39672f1e3a"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:32.317286 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-dbddedb9-1645-41b1-9f69-f3496bdc22ea req-2ff70ecb-2403-47af-9142-493c1be53af9 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:32.317716 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-dbddedb9-1645-41b1-9f69-f3496bdc22ea req-2ff70ecb-2403-47af-9142-493c1be53af9 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:32.333500 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-dbddedb9-1645-41b1-9f69-f3496bdc22ea req-2ff70ecb-2403-47af-9142-493c1be53af9 service nova] Creating event network-vif-deleted:b53cc247-1a43-4485-97e1-5c39672f1e3a for instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 on hv-cinder-77819 May 19 12:31:32.339583 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-dbddedb9-1645-41b1-9f69-f3496bdc22ea req-2ff70ecb-2403-47af-9142-493c1be53af9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042508 May 19 12:31:32.341290 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 414/865] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:32.387700 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1a2bd7a5-d8c1-44c2-a096-33589587c31a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:32.395180 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1a2bd7a5-d8c1-44c2-a096-33589587c31a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:32.410823 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1a2bd7a5-d8c1-44c2-a096-33589587c31a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:32.411591 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1a2bd7a5-d8c1-44c2-a096-33589587c31a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:32.412810 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1a2bd7a5-d8c1-44c2-a096-33589587c31a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:32.413592 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1a2bd7a5-d8c1-44c2-a096-33589587c31a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:32.455429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1a2bd7a5-d8c1-44c2-a096-33589587c31a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Going to try to terminate instance {{(pid=118112) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:31:32.835652 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1a2bd7a5-d8c1-44c2-a096-33589587c31a tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "DELETE /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 204 len: 0 microversion: 2.1 time: 0.457767 May 19 12:31:32.836305 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 452/866] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:31:32 2022] DELETE /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:31:32.845808 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c91da82c-cecb-44b2-8d2a-d66d77273726 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:32.846748 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c91da82c-cecb-44b2-8d2a-d66d77273726 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:32.853546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c91da82c-cecb-44b2-8d2a-d66d77273726 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:32.854009 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c91da82c-cecb-44b2-8d2a-d66d77273726 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:32.854837 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c91da82c-cecb-44b2-8d2a-d66d77273726 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:32.855280 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c91da82c-cecb-44b2-8d2a-d66d77273726 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:32.860515 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:32.875501 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3c327a77-9711-4f61-a6fc-5284d7efe057 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:32.875501 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3c327a77-9711-4f61-a6fc-5284d7efe057 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:32.881612 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3c327a77-9711-4f61-a6fc-5284d7efe057 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:32.882158 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3c327a77-9711-4f61-a6fc-5284d7efe057 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:32.884047 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3c327a77-9711-4f61-a6fc-5284d7efe057 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:32.885239 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3c327a77-9711-4f61-a6fc-5284d7efe057 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:32.933997 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3c327a77-9711-4f61-a6fc-5284d7efe057 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:32.934549 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3c327a77-9711-4f61-a6fc-5284d7efe057 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:32.935220 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-3c327a77-9711-4f61-a6fc-5284d7efe057 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lazy-loading 'fault' on Instance uuid c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:31:32.994499 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3c327a77-9711-4f61-a6fc-5284d7efe057 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:33.004383 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3c327a77-9711-4f61-a6fc-5284d7efe057 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1325 microversion: 2.1 time: 0.144551 May 19 12:31:33.005358 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 453/867] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:32 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1325 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:33.067374 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c91da82c-cecb-44b2-8d2a-d66d77273726 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:33.076297 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c91da82c-cecb-44b2-8d2a-d66d77273726 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1554 microversion: 2.1 time: 0.235189 May 19 12:31:33.078016 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 415/868] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:32 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:34.028279 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d022aace-6015-4d1b-95ea-e2163e7b2872 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:34.028898 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d022aace-6015-4d1b-95ea-e2163e7b2872 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:34.035574 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d022aace-6015-4d1b-95ea-e2163e7b2872 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:34.036023 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d022aace-6015-4d1b-95ea-e2163e7b2872 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:34.036911 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d022aace-6015-4d1b-95ea-e2163e7b2872 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:34.037303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d022aace-6015-4d1b-95ea-e2163e7b2872 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:34.072886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d022aace-6015-4d1b-95ea-e2163e7b2872 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:34.073336 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d022aace-6015-4d1b-95ea-e2163e7b2872 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:34.073790 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-d022aace-6015-4d1b-95ea-e2163e7b2872 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lazy-loading 'fault' on Instance uuid c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:31:34.094962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fe02ba62-b927-45ed-afd6-f8332db37d5f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:34.096262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fe02ba62-b927-45ed-afd6-f8332db37d5f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:34.103782 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fe02ba62-b927-45ed-afd6-f8332db37d5f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:34.104242 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fe02ba62-b927-45ed-afd6-f8332db37d5f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:34.105028 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fe02ba62-b927-45ed-afd6-f8332db37d5f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:34.105471 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fe02ba62-b927-45ed-afd6-f8332db37d5f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:34.118986 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d022aace-6015-4d1b-95ea-e2163e7b2872 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:34.127072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d022aace-6015-4d1b-95ea-e2163e7b2872 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 200 len: 1325 microversion: 2.1 time: 0.102957 May 19 12:31:34.128287 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 454/869] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:34 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 1325 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:34.256539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-fe02ba62-b927-45ed-afd6-f8332db37d5f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:34.264507 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fe02ba62-b927-45ed-afd6-f8332db37d5f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1554 microversion: 2.1 time: 0.173355 May 19 12:31:34.265043 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 416/870] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:34 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:35.146020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-21218e47-dc00-4514-bd43-03600c532334 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:35.146671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-21218e47-dc00-4514-bd43-03600c532334 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:35.153458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-21218e47-dc00-4514-bd43-03600c532334 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:35.153909 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-21218e47-dc00-4514-bd43-03600c532334 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:35.154799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-21218e47-dc00-4514-bd43-03600c532334 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:35.155234 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-21218e47-dc00-4514-bd43-03600c532334 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:35.168912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-21218e47-dc00-4514-bd43-03600c532334 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] HTTP exception thrown: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-21218e47-dc00-4514-bd43-03600c532334 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Request method failure captured: May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 HTTP/1.1 May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjbwSKiUFb7n4kp-B0wgMSyJehaE2r31sB0ovCPEa1ZhaHr058DFVt-yZusv6D-XcO8n44_WxnqFgpFiiJEPNyO7jrMuWvjCunkvXRIvGlpwVcxx8_l991qKHuXtJld0dpF9JLdPibUe0V-fXZ0b6Qx3OMEHcM3vYgr2NHsGNrSoR-8 May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 4f4a6b5e282e45ffbef6963200558594 May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeTestJSON-1862282835 May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:31:35.170627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:31:35.172042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f4a6b5e282e45ffbef6963200558594", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:31:35.172042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeTestJSON-1862282835 May 19 12:31:35.172042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 4f4a6b5e282e45ffbef6963200558594 May 19 12:31:35.172042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1862282835 May 19 12:31:35.172042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeTestJSON-1862282835-project May 19 12:31:35.172042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:31:35.172042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:31:35.172042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 707a899d6c5d4c4ea1c58e0de6a85b1d May 19 12:31:35.172042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeTestJSON-1862282835-project May 19 12:31:35.172042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:31:35.172042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:31:35.172042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': 'c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1'} May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:31:35.172845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:31:35.174125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:35.175542 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-21218e47-dc00-4514-bd43-03600c532334 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Returning 404 to user: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:31:35.175542 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-21218e47-dc00-4514-bd43-03600c532334 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 404 len: 111 microversion: 2.1 time: 0.030863 May 19 12:31:35.175542 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 455/871] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:35 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:31:35.181778 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-65632e08-d3b6-47a7-94d7-6d0d4b04f212 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '.version_select at 0x7fd454fc1790>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:35.270589 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-65632e08-d3b6-47a7-94d7-6d0d4b04f212 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-58744428" status: 202 len: 0 microversion: 2.1 time: 0.092837 May 19 12:31:35.271224 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 417/872] 10.222.0.57 () {58 vars in 1214 bytes} [Thu May 19 12:31:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-58744428 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:31:35.282894 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4886ba82-efc2-483d-bb44-cb0e282bca7e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:35.283906 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4886ba82-efc2-483d-bb44-cb0e282bca7e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:35.290241 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4886ba82-efc2-483d-bb44-cb0e282bca7e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:35.290736 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4886ba82-efc2-483d-bb44-cb0e282bca7e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:35.291749 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4886ba82-efc2-483d-bb44-cb0e282bca7e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:35.292086 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4886ba82-efc2-483d-bb44-cb0e282bca7e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:35.450999 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4886ba82-efc2-483d-bb44-cb0e282bca7e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:35.459601 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4886ba82-efc2-483d-bb44-cb0e282bca7e tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1554 microversion: 2.1 time: 0.180684 May 19 12:31:35.460167 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 456/873] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:35 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:36.348992 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-ca00c4e9-a16e-4212-99f2-dd896b8e5553 req-337d1d31-8792-4542-aa29-6bfba964248f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70659f4e-c927-47dc-a23a-abd0db258731", "name": "network-vif-deleted", "tag": "d7221580-bd77-42eb-a222-b1dd8a491c4c"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:36.360353 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ca00c4e9-a16e-4212-99f2-dd896b8e5553 req-337d1d31-8792-4542-aa29-6bfba964248f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:36.361099 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ca00c4e9-a16e-4212-99f2-dd896b8e5553 req-337d1d31-8792-4542-aa29-6bfba964248f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:36.374576 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-ca00c4e9-a16e-4212-99f2-dd896b8e5553 req-337d1d31-8792-4542-aa29-6bfba964248f service nova] Creating event network-vif-deleted:d7221580-bd77-42eb-a222-b1dd8a491c4c for instance 70659f4e-c927-47dc-a23a-abd0db258731 on hv-cinder-77819 May 19 12:31:36.380919 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-ca00c4e9-a16e-4212-99f2-dd896b8e5553 req-337d1d31-8792-4542-aa29-6bfba964248f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036084 May 19 12:31:36.381571 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 418/874] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:36.463933 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c6506939-ae74-4e06-be7f-de884ab66803 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Action: 'create', calling method: .version_select at 0x7fd4558215e0>, body: {"keypair": {"name": "tempest-keypair-1863777594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIKfehgTseFF7AhG+Ot1lE39x3QM/2LTre/M3KSzs2rz259A5v1vehTL+0p/kCIUqkxcdTUEIgmqLS1eVuHh8kOx+wF91fXLRF1sDM9Umq7OmYXmBOKw9l98dNuB2lAkg=="}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:36.477899 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-be587e10-d4a8-4fb6-acb0-24d18949e0b8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:36.478883 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-be587e10-d4a8-4fb6-acb0-24d18949e0b8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:36.480198 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-c6506939-ae74-4e06-be7f-de884ab66803 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Getting quotas for project 4f4a6b5e282e45ffbef6963200558594. Resources: {'key_pairs'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:31:36.484644 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-c6506939-ae74-4e06-be7f-de884ab66803 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Getting quotas for user 707a899d6c5d4c4ea1c58e0de6a85b1d and project 4f4a6b5e282e45ffbef6963200558594. Resources: {'key_pairs'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:31:36.485235 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be587e10-d4a8-4fb6-acb0-24d18949e0b8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:36.485697 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be587e10-d4a8-4fb6-acb0-24d18949e0b8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:36.486505 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be587e10-d4a8-4fb6-acb0-24d18949e0b8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:36.487441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be587e10-d4a8-4fb6-acb0-24d18949e0b8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:36.556100 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-be587e10-d4a8-4fb6-acb0-24d18949e0b8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:36.563700 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-be587e10-d4a8-4fb6-acb0-24d18949e0b8 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1512 microversion: 2.1 time: 0.090181 May 19 12:31:36.564815 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 419/875] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:36 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1512 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:36.584351 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c6506939-ae74-4e06-be7f-de884ab66803 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124385 May 19 12:31:36.584948 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 457/876] 10.222.0.57 () {60 vars in 1158 bytes} [Thu May 19 12:31:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:37.583316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-28864315-7161-49e2-8473-68b0b3853ddf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:37.587547 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-28864315-7161-49e2-8473-68b0b3853ddf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:37.590836 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28864315-7161-49e2-8473-68b0b3853ddf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:37.591282 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28864315-7161-49e2-8473-68b0b3853ddf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:37.592419 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28864315-7161-49e2-8473-68b0b3853ddf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:37.592548 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28864315-7161-49e2-8473-68b0b3853ddf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:37.628434 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28864315-7161-49e2-8473-68b0b3853ddf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:37.629032 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-28864315-7161-49e2-8473-68b0b3853ddf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:37.629495 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-28864315-7161-49e2-8473-68b0b3853ddf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lazy-loading 'fault' on Instance uuid 70659f4e-c927-47dc-a23a-abd0db258731 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:31:37.671581 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-28864315-7161-49e2-8473-68b0b3853ddf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:37.680231 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-28864315-7161-49e2-8473-68b0b3853ddf tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1347 microversion: 2.1 time: 0.102859 May 19 12:31:37.681030 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 420/877] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:37 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1347 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:38.697969 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8d51c541-d090-4dc6-8203-600727d317e6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:38.698558 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8d51c541-d090-4dc6-8203-600727d317e6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:38.705276 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8d51c541-d090-4dc6-8203-600727d317e6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:38.710568 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8d51c541-d090-4dc6-8203-600727d317e6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:38.710568 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8d51c541-d090-4dc6-8203-600727d317e6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:38.710568 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8d51c541-d090-4dc6-8203-600727d317e6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:38.740855 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8d51c541-d090-4dc6-8203-600727d317e6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:38.741305 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8d51c541-d090-4dc6-8203-600727d317e6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:38.741753 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-8d51c541-d090-4dc6-8203-600727d317e6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lazy-loading 'fault' on Instance uuid 70659f4e-c927-47dc-a23a-abd0db258731 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:31:38.784141 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8d51c541-d090-4dc6-8203-600727d317e6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:38.792315 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8d51c541-d090-4dc6-8203-600727d317e6 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1347 microversion: 2.1 time: 0.098814 May 19 12:31:38.792879 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 458/878] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:38 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1347 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:39.168031 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-531383960", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "89c57c7f-4a52-4f23-b0c9-a848f66927a4"}], "security_groups": [{"name": "tempest-securitygroup--971573804"}], "key_name": "tempest-keypair-1863777594", "user_data": "}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:39.276226 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] validate_networks() for [('89c57c7f-4a52-4f23-b0c9-a848f66927a4', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:31:39.671064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:31:39.671493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:31:39.672061 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:31:39.672472 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:31:39.672890 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:31:39.682674 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:39.687061 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:39.687061 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:39.687061 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:39.701381 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Getting quotas for project 4f4a6b5e282e45ffbef6963200558594. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:31:39.705373 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Getting quotas for user 707a899d6c5d4c4ea1c58e0de6a85b1d and project 4f4a6b5e282e45ffbef6963200558594. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:31:39.716697 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:31:39.719075 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:31:39.810157 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9e865a5a-3f07-4f22-a9c8-87b0432156a5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:39.810723 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9e865a5a-3f07-4f22-a9c8-87b0432156a5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:39.817432 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9e865a5a-3f07-4f22-a9c8-87b0432156a5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:39.817879 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9e865a5a-3f07-4f22-a9c8-87b0432156a5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:39.818752 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9e865a5a-3f07-4f22-a9c8-87b0432156a5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:39.819191 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9e865a5a-3f07-4f22-a9c8-87b0432156a5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:39.850174 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9e865a5a-3f07-4f22-a9c8-87b0432156a5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:39.850652 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9e865a5a-3f07-4f22-a9c8-87b0432156a5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:39.851111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-9e865a5a-3f07-4f22-a9c8-87b0432156a5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lazy-loading 'fault' on Instance uuid 70659f4e-c927-47dc-a23a-abd0db258731 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:31:39.882978 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bf7513aa-3dda-4e97-9aa2-6cc3ec97a966 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.719008 May 19 12:31:39.883742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 421/879] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:31:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:31:39.893734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9e865a5a-3f07-4f22-a9c8-87b0432156a5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cf7a5b535234632bb00a9b87ceb5354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be6c3cdf062493184ab67ec3ec9940f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:39.893995 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-30ef4050-386a-4f03-9d98-348a373d9605 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:39.895132 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-30ef4050-386a-4f03-9d98-348a373d9605 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:39.905376 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9e865a5a-3f07-4f22-a9c8-87b0432156a5 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 200 len: 1347 microversion: 2.1 time: 0.098635 May 19 12:31:39.906132 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 459/880] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:39 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 1347 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:39.964209 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-30ef4050-386a-4f03-9d98-348a373d9605 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:39.973131 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-30ef4050-386a-4f03-9d98-348a373d9605 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1237 microversion: 2.1 time: 0.082801 May 19 12:31:39.973722 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 422/881] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:39 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:40.922582 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ca5d3c04-fff6-40ad-ad1a-d31f8f40421f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:40.923428 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ca5d3c04-fff6-40ad-ad1a-d31f8f40421f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] [instance: 70659f4e-c927-47dc-a23a-abd0db258731] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:40.930593 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca5d3c04-fff6-40ad-ad1a-d31f8f40421f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:40.931041 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca5d3c04-fff6-40ad-ad1a-d31f8f40421f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:40.931853 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca5d3c04-fff6-40ad-ad1a-d31f8f40421f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:40.932290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca5d3c04-fff6-40ad-ad1a-d31f8f40421f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:40.946706 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-ca5d3c04-fff6-40ad-ad1a-d31f8f40421f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] HTTP exception thrown: Instance 70659f4e-c927-47dc-a23a-abd0db258731 could not be found. May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ca5d3c04-fff6-40ad-ad1a-d31f8f40421f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Request method failure captured: May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 HTTP/1.1 May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjeT5tlNY6Fs9sruvZrza3x-EVsseUCsu63bmMKuzmHwger7gJ9elbw6P6GsuljE_Koiv-EIC5bqn8LyBL6yNH-R21lhTomn0vA3khn_2Nf6eHf-6uBlBQV_eGyZPV3DejGN_9-_KPzxDcRmS3f6KzjtejRerVODfFa7WrrLeu14Dok May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 3be6c3cdf062493184ab67ec3ec9940f May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-TestMinimumBasicScenario-585859668 May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:31:40.948303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:31:40.949977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3be6c3cdf062493184ab67ec3ec9940f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/3be6c3cdf062493184ab67ec3ec9940f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/3be6c3cdf062493184ab67ec3ec9940f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_3be6c3cdf062493184ab67ec3ec9940f", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:31:40.949977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-TestMinimumBasicScenario-585859668 May 19 12:31:40.949977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 3be6c3cdf062493184ab67ec3ec9940f May 19 12:31:40.949977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-TestMinimumBasicScenario-585859668 May 19 12:31:40.949977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-TestMinimumBasicScenario-585859668-project May 19 12:31:40.949977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:31:40.949977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:31:40.949977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 3cf7a5b535234632bb00a9b87ceb5354 May 19 12:31:40.949977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-TestMinimumBasicScenario-585859668-project May 19 12:31:40.949977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:31:40.949977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 70659f4e-c927-47dc-a23a-abd0db258731 could not be found. May 19 12:31:40.949977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '70659f4e-c927-47dc-a23a-abd0db258731'} May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70659f4e-c927-47dc-a23a-abd0db258731 could not be found. May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:31:40.950920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70659f4e-c927-47dc-a23a-abd0db258731 could not be found. May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70659f4e-c927-47dc-a23a-abd0db258731 could not be found. May 19 12:31:40.952502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:31:40.953859 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ca5d3c04-fff6-40ad-ad1a-d31f8f40421f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Returning 404 to user: Instance 70659f4e-c927-47dc-a23a-abd0db258731 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:31:40.953859 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ca5d3c04-fff6-40ad-ad1a-d31f8f40421f tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731" status: 404 len: 111 microversion: 2.1 time: 0.031162 May 19 12:31:40.953859 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 460/882] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:40 2022] GET /compute/v2.1/servers/70659f4e-c927-47dc-a23a-abd0db258731 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:31:40.959166 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fcfa7fa9-2ad8-47b9-a592-7602481ed803 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] Calling method '.version_select at 0x7fd455115310>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:40.991712 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6e77d5c1-46bf-42c1-821e-2c7b352eb9e0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:40.992325 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6e77d5c1-46bf-42c1-821e-2c7b352eb9e0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:40.998338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e77d5c1-46bf-42c1-821e-2c7b352eb9e0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:41.001160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e77d5c1-46bf-42c1-821e-2c7b352eb9e0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:41.001160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e77d5c1-46bf-42c1-821e-2c7b352eb9e0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:41.001160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6e77d5c1-46bf-42c1-821e-2c7b352eb9e0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:41.072189 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6e77d5c1-46bf-42c1-821e-2c7b352eb9e0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:41.080915 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6e77d5c1-46bf-42c1-821e-2c7b352eb9e0 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1241 microversion: 2.1 time: 0.093846 May 19 12:31:41.082431 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fcfa7fa9-2ad8-47b9-a592-7602481ed803 tempest-TestMinimumBasicScenario-585859668 tempest-TestMinimumBasicScenario-585859668-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-442604293" status: 202 len: 0 microversion: 2.1 time: 0.126841 May 19 12:31:41.090431 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 461/883] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:40 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:41.090950 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 423/884] 10.222.0.57 () {58 vars in 1268 bytes} [Thu May 19 12:31:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-442604293 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:31:42.107961 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-114988d4-3a32-46ef-a66b-f25a75b529cd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:42.107961 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-114988d4-3a32-46ef-a66b-f25a75b529cd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:42.112672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-114988d4-3a32-46ef-a66b-f25a75b529cd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:42.113418 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-114988d4-3a32-46ef-a66b-f25a75b529cd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:42.114197 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-114988d4-3a32-46ef-a66b-f25a75b529cd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:42.114664 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-114988d4-3a32-46ef-a66b-f25a75b529cd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:42.117607 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:42.192449 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-114988d4-3a32-46ef-a66b-f25a75b529cd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:42.200252 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-114988d4-3a32-46ef-a66b-f25a75b529cd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1289 microversion: 2.1 time: 0.098748 May 19 12:31:42.201179 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 462/885] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:42 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1289 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:43.219670 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-208eb04c-d3e4-4795-9a8f-90c681fb2f15 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:43.220328 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-208eb04c-d3e4-4795-9a8f-90c681fb2f15 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:43.228015 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-208eb04c-d3e4-4795-9a8f-90c681fb2f15 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:43.228463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-208eb04c-d3e4-4795-9a8f-90c681fb2f15 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:43.229244 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-208eb04c-d3e4-4795-9a8f-90c681fb2f15 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:43.229686 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-208eb04c-d3e4-4795-9a8f-90c681fb2f15 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:43.377148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-208eb04c-d3e4-4795-9a8f-90c681fb2f15 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:43.385589 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-208eb04c-d3e4-4795-9a8f-90c681fb2f15 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1307 microversion: 2.1 time: 0.170573 May 19 12:31:43.386299 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 424/886] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:43 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1307 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:44.404827 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0e1d4079-0531-447c-bc59-1a5c87d35792 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:44.405505 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0e1d4079-0531-447c-bc59-1a5c87d35792 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:44.413384 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0e1d4079-0531-447c-bc59-1a5c87d35792 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:44.413875 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0e1d4079-0531-447c-bc59-1a5c87d35792 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:44.414687 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0e1d4079-0531-447c-bc59-1a5c87d35792 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:44.415125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0e1d4079-0531-447c-bc59-1a5c87d35792 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:44.539959 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0e1d4079-0531-447c-bc59-1a5c87d35792 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:44.548133 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0e1d4079-0531-447c-bc59-1a5c87d35792 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1295 microversion: 2.1 time: 0.147866 May 19 12:31:44.548712 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 463/887] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:44 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1295 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:45.569554 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-834d5d76-58ec-4a89-a8e3-ca505961801b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:45.570222 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-834d5d76-58ec-4a89-a8e3-ca505961801b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:45.576785 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-834d5d76-58ec-4a89-a8e3-ca505961801b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:45.577243 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-834d5d76-58ec-4a89-a8e3-ca505961801b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:45.578024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-834d5d76-58ec-4a89-a8e3-ca505961801b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:45.578511 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-834d5d76-58ec-4a89-a8e3-ca505961801b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:45.723745 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-834d5d76-58ec-4a89-a8e3-ca505961801b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:45.731241 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-834d5d76-58ec-4a89-a8e3-ca505961801b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.166905 May 19 12:31:45.731802 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 425/888] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:45 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:46.749531 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-715efc20-7e48-43d5-aa64-f7ba6c78e9f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:46.750054 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-715efc20-7e48-43d5-aa64-f7ba6c78e9f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:46.752546 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=4 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:46.762213 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-715efc20-7e48-43d5-aa64-f7ba6c78e9f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:46.762774 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-715efc20-7e48-43d5-aa64-f7ba6c78e9f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:46.765631 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-715efc20-7e48-43d5-aa64-f7ba6c78e9f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:46.765631 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-715efc20-7e48-43d5-aa64-f7ba6c78e9f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:46.970381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-715efc20-7e48-43d5-aa64-f7ba6c78e9f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:46.979245 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-715efc20-7e48-43d5-aa64-f7ba6c78e9f9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.234355 May 19 12:31:46.979583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 464/889] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:46 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:47.560956 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-40064922-5d9d-4daa-a4d7-e912988cf883 req-ce1b12f2-9f7c-4180-b81a-e3c279a9e93f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8876a3b-759b-45aa-afa1-c7b04fbc1c30", "tag": "547b537a-61af-4d9e-a3b4-3111d357ff91"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:47.571948 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-40064922-5d9d-4daa-a4d7-e912988cf883 req-ce1b12f2-9f7c-4180-b81a-e3c279a9e93f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:47.573232 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-40064922-5d9d-4daa-a4d7-e912988cf883 req-ce1b12f2-9f7c-4180-b81a-e3c279a9e93f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:47.588919 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-40064922-5d9d-4daa-a4d7-e912988cf883 req-ce1b12f2-9f7c-4180-b81a-e3c279a9e93f service nova] Creating event network-changed:547b537a-61af-4d9e-a3b4-3111d357ff91 for instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 on hv-cinder-77819 May 19 12:31:47.598396 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-40064922-5d9d-4daa-a4d7-e912988cf883 req-ce1b12f2-9f7c-4180-b81a-e3c279a9e93f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039680 May 19 12:31:47.599913 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 426/890] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:31:47.998945 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a7d67d48-0f11-4964-8127-e6ec6e251503 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:47.999355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a7d67d48-0f11-4964-8127-e6ec6e251503 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:48.006452 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a7d67d48-0f11-4964-8127-e6ec6e251503 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:48.006903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a7d67d48-0f11-4964-8127-e6ec6e251503 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:48.007686 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a7d67d48-0f11-4964-8127-e6ec6e251503 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:48.008117 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a7d67d48-0f11-4964-8127-e6ec6e251503 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:48.243999 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a7d67d48-0f11-4964-8127-e6ec6e251503 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:48.247694 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a7d67d48-0f11-4964-8127-e6ec6e251503 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.252871 May 19 12:31:48.266091 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 465/891] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:47 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:49.266501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bc1db553-a7d0-42e9-9786-6cf85955f53d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:49.269090 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bc1db553-a7d0-42e9-9786-6cf85955f53d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:49.277719 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bc1db553-a7d0-42e9-9786-6cf85955f53d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:49.278460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bc1db553-a7d0-42e9-9786-6cf85955f53d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:49.279435 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bc1db553-a7d0-42e9-9786-6cf85955f53d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:49.279871 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bc1db553-a7d0-42e9-9786-6cf85955f53d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:49.452342 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-bc1db553-a7d0-42e9-9786-6cf85955f53d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:49.466861 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bc1db553-a7d0-42e9-9786-6cf85955f53d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.200276 May 19 12:31:49.466861 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 427/892] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:49 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:50.480111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e07e1aba-6281-4e2b-b0dc-01c0c946f1b6 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:50.481894 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e07e1aba-6281-4e2b-b0dc-01c0c946f1b6 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:50.488513 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e07e1aba-6281-4e2b-b0dc-01c0c946f1b6 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:50.489538 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e07e1aba-6281-4e2b-b0dc-01c0c946f1b6 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:50.491035 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e07e1aba-6281-4e2b-b0dc-01c0c946f1b6 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:50.492009 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e07e1aba-6281-4e2b-b0dc-01c0c946f1b6 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:50.643553 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e07e1aba-6281-4e2b-b0dc-01c0c946f1b6 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:50.651308 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e07e1aba-6281-4e2b-b0dc-01c0c946f1b6 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.175270 May 19 12:31:50.651800 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 466/893] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:50 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:51.668468 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-78f73e67-3a2d-4475-aff6-0c476f9b3d88 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:51.669816 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-78f73e67-3a2d-4475-aff6-0c476f9b3d88 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:51.672849 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:51.673532 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=8 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:51.678007 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-78f73e67-3a2d-4475-aff6-0c476f9b3d88 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:51.678464 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-78f73e67-3a2d-4475-aff6-0c476f9b3d88 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:51.679472 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-78f73e67-3a2d-4475-aff6-0c476f9b3d88 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:51.679880 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-78f73e67-3a2d-4475-aff6-0c476f9b3d88 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:51.820834 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-78f73e67-3a2d-4475-aff6-0c476f9b3d88 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:51.830293 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-78f73e67-3a2d-4475-aff6-0c476f9b3d88 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.165600 May 19 12:31:51.831532 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 428/894] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:51 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:31:52.848200 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-daf8fd63-d7ef-464b-9aad-ae3b6b9241de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:52.849550 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-daf8fd63-d7ef-464b-9aad-ae3b6b9241de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:52.857125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-daf8fd63-d7ef-464b-9aad-ae3b6b9241de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:52.857125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-daf8fd63-d7ef-464b-9aad-ae3b6b9241de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:52.858303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-daf8fd63-d7ef-464b-9aad-ae3b6b9241de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:52.858303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-daf8fd63-d7ef-464b-9aad-ae3b6b9241de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:53.060935 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-daf8fd63-d7ef-464b-9aad-ae3b6b9241de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:53.068354 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-daf8fd63-d7ef-464b-9aad-ae3b6b9241de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.224074 May 19 12:31:53.068934 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 467/895] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:52 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:54.086298 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f2576f7f-08fb-4f42-badd-1698c1998ce3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:54.086933 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f2576f7f-08fb-4f42-badd-1698c1998ce3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:54.093871 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f2576f7f-08fb-4f42-badd-1698c1998ce3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:54.094358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f2576f7f-08fb-4f42-badd-1698c1998ce3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:54.095147 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f2576f7f-08fb-4f42-badd-1698c1998ce3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:54.095577 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f2576f7f-08fb-4f42-badd-1698c1998ce3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:54.234113 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f2576f7f-08fb-4f42-badd-1698c1998ce3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:54.242255 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f2576f7f-08fb-4f42-badd-1698c1998ce3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.161040 May 19 12:31:54.242872 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 429/896] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:54 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:55.259639 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0282e8d0-4065-4d0a-8032-cbc4bc71409a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:55.260248 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0282e8d0-4065-4d0a-8032-cbc4bc71409a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:55.266807 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0282e8d0-4065-4d0a-8032-cbc4bc71409a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:55.267258 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0282e8d0-4065-4d0a-8032-cbc4bc71409a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:55.268031 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0282e8d0-4065-4d0a-8032-cbc4bc71409a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:55.268464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0282e8d0-4065-4d0a-8032-cbc4bc71409a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:55.400891 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0282e8d0-4065-4d0a-8032-cbc4bc71409a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:55.408278 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0282e8d0-4065-4d0a-8032-cbc4bc71409a tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.153166 May 19 12:31:55.408848 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 468/897] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:55 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:56.425332 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-54ad9aa4-ae09-412c-899d-5b406118a4ad tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:56.426006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-54ad9aa4-ae09-412c-899d-5b406118a4ad tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:56.433673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-54ad9aa4-ae09-412c-899d-5b406118a4ad tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:56.434124 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-54ad9aa4-ae09-412c-899d-5b406118a4ad tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:56.434947 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-54ad9aa4-ae09-412c-899d-5b406118a4ad tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:56.435386 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-54ad9aa4-ae09-412c-899d-5b406118a4ad tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:56.577367 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-54ad9aa4-ae09-412c-899d-5b406118a4ad tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:56.586427 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-54ad9aa4-ae09-412c-899d-5b406118a4ad tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.165019 May 19 12:31:56.587076 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 430/898] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:56 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:57.062863 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-55a3335e-23dc-434e-81a5-bb95730fc38e req-1e45edbb-d88b-4369-a658-79da53a5b044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8876a3b-759b-45aa-afa1-c7b04fbc1c30", "name": "network-vif-plugged", "status": "completed", "tag": "547b537a-61af-4d9e-a3b4-3111d357ff91"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:31:57.072845 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-55a3335e-23dc-434e-81a5-bb95730fc38e req-1e45edbb-d88b-4369-a658-79da53a5b044 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:57.073290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-55a3335e-23dc-434e-81a5-bb95730fc38e req-1e45edbb-d88b-4369-a658-79da53a5b044 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:57.085433 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-55a3335e-23dc-434e-81a5-bb95730fc38e req-1e45edbb-d88b-4369-a658-79da53a5b044 service nova] Creating event network-vif-plugged:547b537a-61af-4d9e-a3b4-3111d357ff91 for instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 on hv-cinder-77819 May 19 12:31:57.090701 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-55a3335e-23dc-434e-81a5-bb95730fc38e req-1e45edbb-d88b-4369-a658-79da53a5b044 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031407 May 19 12:31:57.091298 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 469/899] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:31:57.604557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b894e933-0876-4017-9e01-fa5e621b14a4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:57.605167 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b894e933-0876-4017-9e01-fa5e621b14a4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:57.611673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b894e933-0876-4017-9e01-fa5e621b14a4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:57.612120 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b894e933-0876-4017-9e01-fa5e621b14a4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:57.612877 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b894e933-0876-4017-9e01-fa5e621b14a4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:57.613309 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b894e933-0876-4017-9e01-fa5e621b14a4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:57.746706 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b894e933-0876-4017-9e01-fa5e621b14a4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:57.752743 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b894e933-0876-4017-9e01-fa5e621b14a4 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.152105 May 19 12:31:57.753339 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 431/900] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:57 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:58.771704 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a106cf74-c98e-45ec-89f2-03116c01979d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:58.772395 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a106cf74-c98e-45ec-89f2-03116c01979d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:58.774329 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:31:58.779527 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a106cf74-c98e-45ec-89f2-03116c01979d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:58.780003 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a106cf74-c98e-45ec-89f2-03116c01979d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:58.780903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a106cf74-c98e-45ec-89f2-03116c01979d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:58.781398 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a106cf74-c98e-45ec-89f2-03116c01979d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:58.918797 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a106cf74-c98e-45ec-89f2-03116c01979d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:31:58.926233 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a106cf74-c98e-45ec-89f2-03116c01979d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.159737 May 19 12:31:58.926827 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 470/901] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:58 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:31:59.944972 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d535e129-e7b2-4751-abf7-70ac75eae349 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:31:59.945579 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d535e129-e7b2-4751-abf7-70ac75eae349 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:31:59.952393 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d535e129-e7b2-4751-abf7-70ac75eae349 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:59.952846 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d535e129-e7b2-4751-abf7-70ac75eae349 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:31:59.953635 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d535e129-e7b2-4751-abf7-70ac75eae349 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:31:59.954064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d535e129-e7b2-4751-abf7-70ac75eae349 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:00.089880 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d535e129-e7b2-4751-abf7-70ac75eae349 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:00.098075 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d535e129-e7b2-4751-abf7-70ac75eae349 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.157223 May 19 12:32:00.098672 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 432/902] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:31:59 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:01.116826 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fa776c04-b74c-4eba-83f7-29633715ad34 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:01.117426 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fa776c04-b74c-4eba-83f7-29633715ad34 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:01.124018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa776c04-b74c-4eba-83f7-29633715ad34 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:01.124465 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa776c04-b74c-4eba-83f7-29633715ad34 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:01.125231 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa776c04-b74c-4eba-83f7-29633715ad34 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:01.125671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa776c04-b74c-4eba-83f7-29633715ad34 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:01.265035 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fa776c04-b74c-4eba-83f7-29633715ad34 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:01.273305 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fa776c04-b74c-4eba-83f7-29633715ad34 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.160957 May 19 12:32:01.273949 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 471/903] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:01 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:02.291276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e9eeb3bf-67ba-46db-947a-f946039fe238 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:02.292169 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e9eeb3bf-67ba-46db-947a-f946039fe238 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:02.298221 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9eeb3bf-67ba-46db-947a-f946039fe238 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:02.298717 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9eeb3bf-67ba-46db-947a-f946039fe238 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:02.299479 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9eeb3bf-67ba-46db-947a-f946039fe238 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:02.304011 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e9eeb3bf-67ba-46db-947a-f946039fe238 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:02.432676 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e9eeb3bf-67ba-46db-947a-f946039fe238 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:02.440187 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e9eeb3bf-67ba-46db-947a-f946039fe238 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1362 microversion: 2.1 time: 0.153895 May 19 12:32:02.440758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 433/904] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:02 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:03.458191 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8dd76870-f189-4983-8da3-42d64c4be926 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:03.459857 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8dd76870-f189-4983-8da3-42d64c4be926 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:03.467112 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8dd76870-f189-4983-8da3-42d64c4be926 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:03.467554 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8dd76870-f189-4983-8da3-42d64c4be926 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:03.468422 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8dd76870-f189-4983-8da3-42d64c4be926 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:03.468851 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8dd76870-f189-4983-8da3-42d64c4be926 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:03.605729 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8dd76870-f189-4983-8da3-42d64c4be926 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:03.613366 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8dd76870-f189-4983-8da3-42d64c4be926 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1547 microversion: 2.1 time: 0.160027 May 19 12:32:03.617822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 472/905] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:03 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:03.630144 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0bc3da35-8e64-40b1-a12c-729ef7641a83 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:03.630711 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0bc3da35-8e64-40b1-a12c-729ef7641a83 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:03.633135 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:03.637932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0bc3da35-8e64-40b1-a12c-729ef7641a83 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:03.638374 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0bc3da35-8e64-40b1-a12c-729ef7641a83 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:03.639175 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0bc3da35-8e64-40b1-a12c-729ef7641a83 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:03.639601 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0bc3da35-8e64-40b1-a12c-729ef7641a83 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:03.641986 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=86 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:03.725632 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0bc3da35-8e64-40b1-a12c-729ef7641a83 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099449 May 19 12:32:03.726226 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 434/906] 10.222.0.57 () {58 vars in 1274 bytes} [Thu May 19 12:32:03 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:32:05.091942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-0b3f22bd-15e4-4754-906b-6f22ef4e4c8b req-206d31d5-8313-45c9-915d-e9ef622d1db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8876a3b-759b-45aa-afa1-c7b04fbc1c30", "tag": "547b537a-61af-4d9e-a3b4-3111d357ff91"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:32:05.101289 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-0b3f22bd-15e4-4754-906b-6f22ef4e4c8b req-206d31d5-8313-45c9-915d-e9ef622d1db8 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:05.101738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-0b3f22bd-15e4-4754-906b-6f22ef4e4c8b req-206d31d5-8313-45c9-915d-e9ef622d1db8 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:05.112648 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-0b3f22bd-15e4-4754-906b-6f22ef4e4c8b req-206d31d5-8313-45c9-915d-e9ef622d1db8 service nova] Creating event network-changed:547b537a-61af-4d9e-a3b4-3111d357ff91 for instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 on hv-cinder-77819 May 19 12:32:05.117640 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-0b3f22bd-15e4-4754-906b-6f22ef4e4c8b req-206d31d5-8313-45c9-915d-e9ef622d1db8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029285 May 19 12:32:05.118238 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 473/907] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:32:34.904673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-891314642", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "networks": [{"uuid": "7c694785-3877-48e5-968a-02c3883c2332"}]}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:32:34.956992 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] validate_networks() for [('7c694785-3877-48e5-968a-02c3883c2332', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:32:35.326108 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:32:35.326549 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:32:35.327022 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:32:35.327430 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:32:35.327867 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:32:35.337877 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:35.338321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:35.339146 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:35.339574 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:35.358036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Getting quotas for project 886ee445e38e4c31bd4d4d014a7c4c7c. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:32:35.362031 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Getting quotas for user 8f609cfe0d7a4ded8a622c65d8690f7f and project 886ee445e38e4c31bd4d4d014a7c4c7c. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:32:35.373165 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:32:35.375451 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:32:35.533747 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4eff2e35-df3b-4e4b-a09d-837e3d0eecdb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634059 May 19 12:32:35.534614 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 435/908] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:32:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:32:35.542477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=7 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:35.543239 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=63 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:35.547475 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9570be4e-d4a0-4f6e-b812-0ea511c08742 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:35.548729 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9570be4e-d4a0-4f6e-b812-0ea511c08742 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:35.615002 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9570be4e-d4a0-4f6e-b812-0ea511c08742 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:35.621817 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9570be4e-d4a0-4f6e-b812-0ea511c08742 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1218 microversion: 2.1 time: 0.080987 May 19 12:32:35.622682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 474/909] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:35 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:36.640748 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fa7b0ad3-adb5-4feb-abf6-91ee8d8d0cad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:36.641349 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fa7b0ad3-adb5-4feb-abf6-91ee8d8d0cad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:36.648322 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fa7b0ad3-adb5-4feb-abf6-91ee8d8d0cad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:36.648911 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fa7b0ad3-adb5-4feb-abf6-91ee8d8d0cad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:36.654210 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fa7b0ad3-adb5-4feb-abf6-91ee8d8d0cad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:36.654210 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fa7b0ad3-adb5-4feb-abf6-91ee8d8d0cad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:36.715143 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-fa7b0ad3-adb5-4feb-abf6-91ee8d8d0cad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:36.723873 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fa7b0ad3-adb5-4feb-abf6-91ee8d8d0cad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1222 microversion: 2.1 time: 0.087376 May 19 12:32:36.724463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 436/910] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:36 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:37.743045 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-26977c9f-b4fc-4410-8363-52aa6f804bbb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:37.744235 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-26977c9f-b4fc-4410-8363-52aa6f804bbb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:37.756400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-26977c9f-b4fc-4410-8363-52aa6f804bbb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:37.756857 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-26977c9f-b4fc-4410-8363-52aa6f804bbb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:37.757704 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-26977c9f-b4fc-4410-8363-52aa6f804bbb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:37.758203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-26977c9f-b4fc-4410-8363-52aa6f804bbb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:37.841030 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-26977c9f-b4fc-4410-8363-52aa6f804bbb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:37.843707 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-26977c9f-b4fc-4410-8363-52aa6f804bbb tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1270 microversion: 2.1 time: 0.106205 May 19 12:32:37.844275 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 475/911] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:37 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1270 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:32:38.862420 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-74765370-07fe-435f-aa3a-78e071b10296 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:38.863051 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-74765370-07fe-435f-aa3a-78e071b10296 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:38.870174 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-74765370-07fe-435f-aa3a-78e071b10296 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:38.874851 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-74765370-07fe-435f-aa3a-78e071b10296 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:38.874851 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-74765370-07fe-435f-aa3a-78e071b10296 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:38.874851 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-74765370-07fe-435f-aa3a-78e071b10296 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:39.070811 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-74765370-07fe-435f-aa3a-78e071b10296 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:39.078830 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-74765370-07fe-435f-aa3a-78e071b10296 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1318 microversion: 2.1 time: 0.221481 May 19 12:32:39.080250 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 437/912] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:38 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:39.851371 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-b067fac3-5fa1-4f89-b495-e9b896cd6fd7 req-7b2bbd3b-127d-4ff1-8f36-9f769c0b326a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26aaef3d-8e42-46ab-92a8-3a9b1519b806", "tag": "8c94ddec-e1a4-46ea-80e4-6d16db77af3e"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:32:39.861302 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-b067fac3-5fa1-4f89-b495-e9b896cd6fd7 req-7b2bbd3b-127d-4ff1-8f36-9f769c0b326a service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:39.861890 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-b067fac3-5fa1-4f89-b495-e9b896cd6fd7 req-7b2bbd3b-127d-4ff1-8f36-9f769c0b326a service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:39.879014 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-b067fac3-5fa1-4f89-b495-e9b896cd6fd7 req-7b2bbd3b-127d-4ff1-8f36-9f769c0b326a service nova] Creating event network-changed:8c94ddec-e1a4-46ea-80e4-6d16db77af3e for instance 26aaef3d-8e42-46ab-92a8-3a9b1519b806 on hv-cinder-77819 May 19 12:32:39.879251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-b067fac3-5fa1-4f89-b495-e9b896cd6fd7 req-7b2bbd3b-127d-4ff1-8f36-9f769c0b326a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032891 May 19 12:32:39.879852 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 476/913] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:32:40.096993 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-84b714d1-ebd7-437e-81b7-3450015c9a2e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:40.097669 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-84b714d1-ebd7-437e-81b7-3450015c9a2e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:40.104419 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-84b714d1-ebd7-437e-81b7-3450015c9a2e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:40.104865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-84b714d1-ebd7-437e-81b7-3450015c9a2e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:40.105631 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-84b714d1-ebd7-437e-81b7-3450015c9a2e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:40.106065 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-84b714d1-ebd7-437e-81b7-3450015c9a2e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:40.308994 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-84b714d1-ebd7-437e-81b7-3450015c9a2e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:40.317733 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-84b714d1-ebd7-437e-81b7-3450015c9a2e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1318 microversion: 2.1 time: 0.225185 May 19 12:32:40.318320 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 438/914] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:40 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:41.335622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-89c3a055-b696-48e3-9926-9fdf79ff5855 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:41.336379 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-89c3a055-b696-48e3-9926-9fdf79ff5855 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:41.342960 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-89c3a055-b696-48e3-9926-9fdf79ff5855 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:41.343454 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-89c3a055-b696-48e3-9926-9fdf79ff5855 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:41.344221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-89c3a055-b696-48e3-9926-9fdf79ff5855 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:41.345461 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-89c3a055-b696-48e3-9926-9fdf79ff5855 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:41.494760 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-89c3a055-b696-48e3-9926-9fdf79ff5855 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:41.502577 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-89c3a055-b696-48e3-9926-9fdf79ff5855 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1318 microversion: 2.1 time: 0.171714 May 19 12:32:41.503163 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 477/915] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:41 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:42.520904 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9b3934ff-9995-4991-a324-76244189eb54 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:42.521543 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9b3934ff-9995-4991-a324-76244189eb54 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:42.528354 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9b3934ff-9995-4991-a324-76244189eb54 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:42.528798 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9b3934ff-9995-4991-a324-76244189eb54 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:42.529619 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9b3934ff-9995-4991-a324-76244189eb54 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:42.530054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9b3934ff-9995-4991-a324-76244189eb54 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:42.687605 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9b3934ff-9995-4991-a324-76244189eb54 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:42.696453 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9b3934ff-9995-4991-a324-76244189eb54 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1318 microversion: 2.1 time: 0.179463 May 19 12:32:42.697092 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 439/916] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:42 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:43.713893 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d2448f86-10ef-4bb2-be2e-e726a0a48c24 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:43.714489 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d2448f86-10ef-4bb2-be2e-e726a0a48c24 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:43.721569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d2448f86-10ef-4bb2-be2e-e726a0a48c24 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:43.721968 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d2448f86-10ef-4bb2-be2e-e726a0a48c24 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:43.728578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d2448f86-10ef-4bb2-be2e-e726a0a48c24 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:43.728578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d2448f86-10ef-4bb2-be2e-e726a0a48c24 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:43.859182 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d2448f86-10ef-4bb2-be2e-e726a0a48c24 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:43.867053 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d2448f86-10ef-4bb2-be2e-e726a0a48c24 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1318 microversion: 2.1 time: 0.157119 May 19 12:32:43.871863 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 478/917] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:43 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:44.883942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-60d50e2a-9c89-4429-88cb-9e7680ae80ad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:44.884587 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-60d50e2a-9c89-4429-88cb-9e7680ae80ad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:44.891043 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-60d50e2a-9c89-4429-88cb-9e7680ae80ad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:44.895261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-60d50e2a-9c89-4429-88cb-9e7680ae80ad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:44.895261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-60d50e2a-9c89-4429-88cb-9e7680ae80ad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:44.895261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-60d50e2a-9c89-4429-88cb-9e7680ae80ad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:45.025355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-60d50e2a-9c89-4429-88cb-9e7680ae80ad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:45.033262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-60d50e2a-9c89-4429-88cb-9e7680ae80ad tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1318 microversion: 2.1 time: 0.153070 May 19 12:32:45.033842 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 440/918] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:44 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:46.050364 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0f85b231-0762-4fdb-8992-2fb67258c080 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:46.051011 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0f85b231-0762-4fdb-8992-2fb67258c080 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:46.053508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:46.058717 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0f85b231-0762-4fdb-8992-2fb67258c080 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:46.068063 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0f85b231-0762-4fdb-8992-2fb67258c080 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:46.068063 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0f85b231-0762-4fdb-8992-2fb67258c080 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:46.068063 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0f85b231-0762-4fdb-8992-2fb67258c080 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:46.195996 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0f85b231-0762-4fdb-8992-2fb67258c080 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:46.203486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0f85b231-0762-4fdb-8992-2fb67258c080 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1318 microversion: 2.1 time: 0.157143 May 19 12:32:46.204046 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 479/919] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:46 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:47.220225 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e4265ad5-6b0e-4cca-ba77-423182a37c12 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:47.220831 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e4265ad5-6b0e-4cca-ba77-423182a37c12 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:47.222795 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:47.223481 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:32:47.228711 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e4265ad5-6b0e-4cca-ba77-423182a37c12 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:47.229153 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e4265ad5-6b0e-4cca-ba77-423182a37c12 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:47.229910 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e4265ad5-6b0e-4cca-ba77-423182a37c12 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:47.230387 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e4265ad5-6b0e-4cca-ba77-423182a37c12 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:47.372673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e4265ad5-6b0e-4cca-ba77-423182a37c12 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:47.381236 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-6b246a8a-6ab5-45d3-86d0-4728c488c81d req-870cd8ec-21bc-4f47-93c1-aec2abafe1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26aaef3d-8e42-46ab-92a8-3a9b1519b806", "name": "network-vif-plugged", "status": "completed", "tag": "8c94ddec-e1a4-46ea-80e4-6d16db77af3e"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:32:47.381815 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e4265ad5-6b0e-4cca-ba77-423182a37c12 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1318 microversion: 2.1 time: 0.165125 May 19 12:32:47.389962 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-6b246a8a-6ab5-45d3-86d0-4728c488c81d req-870cd8ec-21bc-4f47-93c1-aec2abafe1e9 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:47.390526 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-6b246a8a-6ab5-45d3-86d0-4728c488c81d req-870cd8ec-21bc-4f47-93c1-aec2abafe1e9 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:47.390789 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 441/920] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:47 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:47.402018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-6b246a8a-6ab5-45d3-86d0-4728c488c81d req-870cd8ec-21bc-4f47-93c1-aec2abafe1e9 service nova] Creating event network-vif-plugged:8c94ddec-e1a4-46ea-80e4-6d16db77af3e for instance 26aaef3d-8e42-46ab-92a8-3a9b1519b806 on hv-cinder-77819 May 19 12:32:47.406930 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-6b246a8a-6ab5-45d3-86d0-4728c488c81d req-870cd8ec-21bc-4f47-93c1-aec2abafe1e9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030326 May 19 12:32:47.411331 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 480/921] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:32:48.398099 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3f031167-1795-47da-91f9-0565883c11c7 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:48.398738 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3f031167-1795-47da-91f9-0565883c11c7 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:48.405155 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3f031167-1795-47da-91f9-0565883c11c7 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:48.405590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3f031167-1795-47da-91f9-0565883c11c7 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:48.406343 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3f031167-1795-47da-91f9-0565883c11c7 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:48.406794 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3f031167-1795-47da-91f9-0565883c11c7 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:48.539722 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3f031167-1795-47da-91f9-0565883c11c7 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:48.547659 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3f031167-1795-47da-91f9-0565883c11c7 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1318 microversion: 2.1 time: 0.153974 May 19 12:32:48.548230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 442/922] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:48 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:49.565898 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-31ca93c2-825d-41ba-9fba-d1a9133151fe tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:49.566773 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-31ca93c2-825d-41ba-9fba-d1a9133151fe tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:49.573596 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-31ca93c2-825d-41ba-9fba-d1a9133151fe tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:49.574043 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-31ca93c2-825d-41ba-9fba-d1a9133151fe tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:49.574848 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-31ca93c2-825d-41ba-9fba-d1a9133151fe tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:49.575289 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-31ca93c2-825d-41ba-9fba-d1a9133151fe tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:49.709978 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-31ca93c2-825d-41ba-9fba-d1a9133151fe tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:49.717372 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-31ca93c2-825d-41ba-9fba-d1a9133151fe tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1318 microversion: 2.1 time: 0.156178 May 19 12:32:49.717938 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 481/923] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:49 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:32:50.734677 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3d31b9fc-7c93-45e8-9dd2-4474cfaaf7cd tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:32:50.735270 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3d31b9fc-7c93-45e8-9dd2-4474cfaaf7cd tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:32:50.742485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3d31b9fc-7c93-45e8-9dd2-4474cfaaf7cd tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:50.742933 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3d31b9fc-7c93-45e8-9dd2-4474cfaaf7cd tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:50.743701 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3d31b9fc-7c93-45e8-9dd2-4474cfaaf7cd tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:32:50.744129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3d31b9fc-7c93-45e8-9dd2-4474cfaaf7cd tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:32:50.879543 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3d31b9fc-7c93-45e8-9dd2-4474cfaaf7cd tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:32:50.887809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3d31b9fc-7c93-45e8-9dd2-4474cfaaf7cd tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1506 microversion: 2.1 time: 0.157023 May 19 12:32:50.888387 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 443/924] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:32:50 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:07.026626 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0ac8429e-3451-4959-b60c-7018f64ccbae tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:07.027122 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0ac8429e-3451-4959-b60c-7018f64ccbae tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:07.029272 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=18 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:07.030020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=34 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:07.034776 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ac8429e-3451-4959-b60c-7018f64ccbae tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:07.035218 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ac8429e-3451-4959-b60c-7018f64ccbae tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:07.036034 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ac8429e-3451-4959-b60c-7018f64ccbae tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:07.039647 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ac8429e-3451-4959-b60c-7018f64ccbae tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:07.063763 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0ac8429e-3451-4959-b60c-7018f64ccbae tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/ips" status: 200 len: 151 microversion: 2.20 time: 0.042209 May 19 12:33:07.064375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 482/925] 10.222.0.57 () {60 vars in 1288 bytes} [Thu May 19 12:33:07 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 12:33:10.827978 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-97c9fd45-3a02-4b9f-8b25-39127441d0ed tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:10.828562 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-97c9fd45-3a02-4b9f-8b25-39127441d0ed tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:10.830655 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:10.831303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=53 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:10.836868 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-97c9fd45-3a02-4b9f-8b25-39127441d0ed tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:10.843006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-97c9fd45-3a02-4b9f-8b25-39127441d0ed tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:10.843006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-97c9fd45-3a02-4b9f-8b25-39127441d0ed tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:10.843006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-97c9fd45-3a02-4b9f-8b25-39127441d0ed tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:10.861474 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-97c9fd45-3a02-4b9f-8b25-39127441d0ed tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lazy-loading 'flavor' on Instance uuid 366b434a-af2f-4b06-beda-5bb9b4816e66 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:33:11.524947 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-97c9fd45-3a02-4b9f-8b25-39127441d0ed tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "POST /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/action" status: 202 len: 0 microversion: 2.20 time: 0.700776 May 19 12:33:11.525578 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 444/926] 10.222.0.57 () {62 vars in 1318 bytes} [Thu May 19 12:33:10 2022] POST /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/action => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 12:33:11.535966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d5be5032-1403-4b28-b8c1-851f7a0cf511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:11.536572 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d5be5032-1403-4b28-b8c1-851f7a0cf511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:11.546197 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5be5032-1403-4b28-b8c1-851f7a0cf511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:11.546683 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5be5032-1403-4b28-b8c1-851f7a0cf511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:11.551613 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5be5032-1403-4b28-b8c1-851f7a0cf511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:11.551613 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5be5032-1403-4b28-b8c1-851f7a0cf511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:11.687259 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d5be5032-1403-4b28-b8c1-851f7a0cf511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:11.695735 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d5be5032-1403-4b28-b8c1-851f7a0cf511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:11.698857 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d5be5032-1403-4b28-b8c1-851f7a0cf511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:11.698857 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d5be5032-1403-4b28-b8c1-851f7a0cf511 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1723 microversion: 2.20 time: 0.168636 May 19 12:33:11.699095 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 483/927] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:11 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:33:12.717567 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-92e45895-d56d-4894-a1de-1681b7b3d9e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:12.718205 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-92e45895-d56d-4894-a1de-1681b7b3d9e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:12.724532 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92e45895-d56d-4894-a1de-1681b7b3d9e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:12.726846 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92e45895-d56d-4894-a1de-1681b7b3d9e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:12.726846 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92e45895-d56d-4894-a1de-1681b7b3d9e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:12.726846 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92e45895-d56d-4894-a1de-1681b7b3d9e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:12.858191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-92e45895-d56d-4894-a1de-1681b7b3d9e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:12.866122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-92e45895-d56d-4894-a1de-1681b7b3d9e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:12.867674 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-92e45895-d56d-4894-a1de-1681b7b3d9e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:12.868826 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-92e45895-d56d-4894-a1de-1681b7b3d9e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1723 microversion: 2.20 time: 0.156114 May 19 12:33:12.869389 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 445/928] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:12 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:33:13.887718 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6b63d088-5ed1-44d4-aa27-bc6888ec524a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:13.888251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6b63d088-5ed1-44d4-aa27-bc6888ec524a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:13.894887 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6b63d088-5ed1-44d4-aa27-bc6888ec524a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:13.895343 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6b63d088-5ed1-44d4-aa27-bc6888ec524a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:13.896118 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6b63d088-5ed1-44d4-aa27-bc6888ec524a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:13.896553 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6b63d088-5ed1-44d4-aa27-bc6888ec524a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:14.032680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5e070846-c184-4aba-9f97-2cef1f234477 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:14.033229 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5e070846-c184-4aba-9f97-2cef1f234477 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:14.040209 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5e070846-c184-4aba-9f97-2cef1f234477 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:14.040650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5e070846-c184-4aba-9f97-2cef1f234477 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:14.041432 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5e070846-c184-4aba-9f97-2cef1f234477 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:14.041844 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5e070846-c184-4aba-9f97-2cef1f234477 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:14.065872 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5e070846-c184-4aba-9f97-2cef1f234477 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/ips" status: 200 len: 151 microversion: 2.1 time: 0.036901 May 19 12:33:14.066464 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 446/929] 10.222.0.57 () {58 vars in 1247 bytes} [Thu May 19 12:33:14 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:33:14.109840 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6b63d088-5ed1-44d4-aa27-bc6888ec524a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:14.118715 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6b63d088-5ed1-44d4-aa27-bc6888ec524a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:14.120290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6b63d088-5ed1-44d4-aa27-bc6888ec524a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:14.121606 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6b63d088-5ed1-44d4-aa27-bc6888ec524a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1723 microversion: 2.20 time: 0.238011 May 19 12:33:14.131457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 484/930] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:13 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:15.139985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f5a1d617-3a64-430e-bfe2-91d81c1b0877 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:15.140584 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f5a1d617-3a64-430e-bfe2-91d81c1b0877 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:15.147016 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5a1d617-3a64-430e-bfe2-91d81c1b0877 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:15.147459 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5a1d617-3a64-430e-bfe2-91d81c1b0877 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:15.148241 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5a1d617-3a64-430e-bfe2-91d81c1b0877 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:15.148764 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5a1d617-3a64-430e-bfe2-91d81c1b0877 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:15.281076 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f5a1d617-3a64-430e-bfe2-91d81c1b0877 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:15.289153 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f5a1d617-3a64-430e-bfe2-91d81c1b0877 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:15.290673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f5a1d617-3a64-430e-bfe2-91d81c1b0877 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:15.291838 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f5a1d617-3a64-430e-bfe2-91d81c1b0877 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1723 microversion: 2.20 time: 0.155766 May 19 12:33:15.292397 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 447/931] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:15 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:16.310043 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-aac7a0de-8808-438e-b5e0-9b609c9f29d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:16.310593 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-aac7a0de-8808-438e-b5e0-9b609c9f29d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:16.317085 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-aac7a0de-8808-438e-b5e0-9b609c9f29d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:16.317528 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-aac7a0de-8808-438e-b5e0-9b609c9f29d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:16.318511 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-aac7a0de-8808-438e-b5e0-9b609c9f29d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:16.319015 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-aac7a0de-8808-438e-b5e0-9b609c9f29d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:16.451712 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-aac7a0de-8808-438e-b5e0-9b609c9f29d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:16.460011 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-aac7a0de-8808-438e-b5e0-9b609c9f29d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:16.461526 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-aac7a0de-8808-438e-b5e0-9b609c9f29d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:16.462716 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-aac7a0de-8808-438e-b5e0-9b609c9f29d9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1723 microversion: 2.20 time: 0.156674 May 19 12:33:16.463290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 485/932] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:16 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:16.787857 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-bfca27a4-0d92-4c3a-8406-8b1241719b25 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e96f1115-4319-4abf-85b4-d8c9d6344d1c"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:16.789710 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-bfca27a4-0d92-4c3a-8406-8b1241719b25 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:16.796350 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfca27a4-0d92-4c3a-8406-8b1241719b25 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:16.796813 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfca27a4-0d92-4c3a-8406-8b1241719b25 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:16.797585 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfca27a4-0d92-4c3a-8406-8b1241719b25 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:16.798018 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-bfca27a4-0d92-4c3a-8406-8b1241719b25 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:17.483025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c2f09a0b-37d4-41d6-b0d6-8075a67decca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:17.483635 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c2f09a0b-37d4-41d6-b0d6-8075a67decca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:17.491010 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c2f09a0b-37d4-41d6-b0d6-8075a67decca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:17.491457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c2f09a0b-37d4-41d6-b0d6-8075a67decca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:17.492718 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c2f09a0b-37d4-41d6-b0d6-8075a67decca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:17.493235 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c2f09a0b-37d4-41d6-b0d6-8075a67decca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:17.650721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c2f09a0b-37d4-41d6-b0d6-8075a67decca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:17.662528 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c2f09a0b-37d4-41d6-b0d6-8075a67decca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:17.668303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c2f09a0b-37d4-41d6-b0d6-8075a67decca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:17.668303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c2f09a0b-37d4-41d6-b0d6-8075a67decca tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1723 microversion: 2.20 time: 0.188113 May 19 12:33:17.668303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 486/933] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:17 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:33:17.779281 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-bfca27a4-0d92-4c3a-8406-8b1241719b25 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "POST /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.995075 May 19 12:33:17.779899 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 448/934] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:33:16 2022] POST /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments => generated 194 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:33:18.685415 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-233d1bcb-f7ea-4995-a5b0-4e603730caff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:18.686026 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-233d1bcb-f7ea-4995-a5b0-4e603730caff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:18.692783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-233d1bcb-f7ea-4995-a5b0-4e603730caff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:18.693225 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-233d1bcb-f7ea-4995-a5b0-4e603730caff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:18.693988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-233d1bcb-f7ea-4995-a5b0-4e603730caff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:18.694440 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-233d1bcb-f7ea-4995-a5b0-4e603730caff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:18.826746 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-233d1bcb-f7ea-4995-a5b0-4e603730caff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:18.834836 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-233d1bcb-f7ea-4995-a5b0-4e603730caff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:18.836903 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-233d1bcb-f7ea-4995-a5b0-4e603730caff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:18.838048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-233d1bcb-f7ea-4995-a5b0-4e603730caff tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1723 microversion: 2.20 time: 0.156866 May 19 12:33:18.838646 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 487/935] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:18 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:18.941267 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e6023406-9e17-48ca-8d43-25e58f04bf7d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff056158-f6df-4b38-808a-598fe65cda0c", "device": "/dev/sdb"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:18.942837 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e6023406-9e17-48ca-8d43-25e58f04bf7d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:18.949016 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6023406-9e17-48ca-8d43-25e58f04bf7d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:18.949450 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6023406-9e17-48ca-8d43-25e58f04bf7d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:18.950199 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6023406-9e17-48ca-8d43-25e58f04bf7d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:18.950664 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6023406-9e17-48ca-8d43-25e58f04bf7d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:19.796234 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e6023406-9e17-48ca-8d43-25e58f04bf7d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "POST /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859527 May 19 12:33:19.796845 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 449/936] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:33:18 2022] POST /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:33:19.856486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-95cf415e-54f7-4a13-8164-f36333ee6a42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:19.857092 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-95cf415e-54f7-4a13-8164-f36333ee6a42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:19.863640 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-95cf415e-54f7-4a13-8164-f36333ee6a42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:19.864090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-95cf415e-54f7-4a13-8164-f36333ee6a42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:19.864855 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-95cf415e-54f7-4a13-8164-f36333ee6a42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:19.865287 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-95cf415e-54f7-4a13-8164-f36333ee6a42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:20.004066 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-95cf415e-54f7-4a13-8164-f36333ee6a42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:20.014718 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-95cf415e-54f7-4a13-8164-f36333ee6a42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:20.016331 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-95cf415e-54f7-4a13-8164-f36333ee6a42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:20.017500 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-95cf415e-54f7-4a13-8164-f36333ee6a42 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1723 microversion: 2.20 time: 0.165229 May 19 12:33:20.018136 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 488/937] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:19 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:21.037231 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-12283a95-70d2-4c88-acfb-bf1f143720c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:21.038090 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-12283a95-70d2-4c88-acfb-bf1f143720c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:21.044840 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12283a95-70d2-4c88-acfb-bf1f143720c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:21.045278 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12283a95-70d2-4c88-acfb-bf1f143720c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:21.046045 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12283a95-70d2-4c88-acfb-bf1f143720c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:21.046689 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-12283a95-70d2-4c88-acfb-bf1f143720c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:21.188354 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-12283a95-70d2-4c88-acfb-bf1f143720c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:21.197685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-12283a95-70d2-4c88-acfb-bf1f143720c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:21.199593 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-12283a95-70d2-4c88-acfb-bf1f143720c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:21.200754 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-12283a95-70d2-4c88-acfb-bf1f143720c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1723 microversion: 2.20 time: 0.168341 May 19 12:33:21.201358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 450/938] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:21 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:22.220291 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3f2d4438-cd41-4370-8010-87b530663d2d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:22.220898 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3f2d4438-cd41-4370-8010-87b530663d2d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:22.228166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3f2d4438-cd41-4370-8010-87b530663d2d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:22.228616 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3f2d4438-cd41-4370-8010-87b530663d2d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:22.229389 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3f2d4438-cd41-4370-8010-87b530663d2d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:22.229827 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3f2d4438-cd41-4370-8010-87b530663d2d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:22.362000 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3f2d4438-cd41-4370-8010-87b530663d2d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:22.371347 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3f2d4438-cd41-4370-8010-87b530663d2d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:22.372840 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3f2d4438-cd41-4370-8010-87b530663d2d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:22.373985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3f2d4438-cd41-4370-8010-87b530663d2d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1723 microversion: 2.20 time: 0.157601 May 19 12:33:22.374553 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 489/939] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:22 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:23.392363 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6d69df04-1c42-409a-a4a0-bb437251045f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:23.392971 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6d69df04-1c42-409a-a4a0-bb437251045f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:23.400064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6d69df04-1c42-409a-a4a0-bb437251045f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:23.400513 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6d69df04-1c42-409a-a4a0-bb437251045f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:23.401275 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6d69df04-1c42-409a-a4a0-bb437251045f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:23.401711 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6d69df04-1c42-409a-a4a0-bb437251045f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:23.537138 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6d69df04-1c42-409a-a4a0-bb437251045f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:23.542090 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6d69df04-1c42-409a-a4a0-bb437251045f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:23.543639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6d69df04-1c42-409a-a4a0-bb437251045f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:23.544821 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6d69df04-1c42-409a-a4a0-bb437251045f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1723 microversion: 2.20 time: 0.156414 May 19 12:33:23.545386 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 451/940] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:23 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:24.564616 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f48f342a-36bb-4dea-834d-f5ab88723005 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:24.565229 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f48f342a-36bb-4dea-834d-f5ab88723005 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:24.572889 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f48f342a-36bb-4dea-834d-f5ab88723005 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:24.573375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f48f342a-36bb-4dea-834d-f5ab88723005 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:24.574172 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f48f342a-36bb-4dea-834d-f5ab88723005 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:24.574679 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f48f342a-36bb-4dea-834d-f5ab88723005 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:24.721363 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f48f342a-36bb-4dea-834d-f5ab88723005 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:24.732197 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f48f342a-36bb-4dea-834d-f5ab88723005 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:24.734907 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f48f342a-36bb-4dea-834d-f5ab88723005 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:24.736177 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f48f342a-36bb-4dea-834d-f5ab88723005 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1744 microversion: 2.20 time: 0.176742 May 19 12:33:24.737018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 490/941] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:24 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:25.757704 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-22d66d53-c00e-45f7-ae01-e6594a34164a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:25.758592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-22d66d53-c00e-45f7-ae01-e6594a34164a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:25.765006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22d66d53-c00e-45f7-ae01-e6594a34164a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:25.765479 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22d66d53-c00e-45f7-ae01-e6594a34164a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:25.766251 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22d66d53-c00e-45f7-ae01-e6594a34164a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:25.766721 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22d66d53-c00e-45f7-ae01-e6594a34164a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:25.900844 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-22d66d53-c00e-45f7-ae01-e6594a34164a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:25.908733 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-22d66d53-c00e-45f7-ae01-e6594a34164a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:25.910221 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-22d66d53-c00e-45f7-ae01-e6594a34164a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:25.911407 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-22d66d53-c00e-45f7-ae01-e6594a34164a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1744 microversion: 2.20 time: 0.158607 May 19 12:33:25.911967 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 452/942] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:25 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:26.352053 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a5288a65-bbdd-4313-b9ff-fc8e60f3483a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e96f1115-4319-4abf-85b4-d8c9d6344d1c"}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:26.353253 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a5288a65-bbdd-4313-b9ff-fc8e60f3483a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:26.360190 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a5288a65-bbdd-4313-b9ff-fc8e60f3483a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:26.360641 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a5288a65-bbdd-4313-b9ff-fc8e60f3483a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:26.361462 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a5288a65-bbdd-4313-b9ff-fc8e60f3483a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:26.361899 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a5288a65-bbdd-4313-b9ff-fc8e60f3483a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:26.443135 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-a5288a65-bbdd-4313-b9ff-fc8e60f3483a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Invalid volume: volume e96f1115-4319-4abf-85b4-d8c9d6344d1c is already attached to instances: 5bd02616-e81f-4372-89c1-8a9f63588512 May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a5288a65-bbdd-4313-b9ff-fc8e60f3483a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: POST /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments HTTP/1.1 May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 74 May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:33:26.445457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:33:26.447125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:33:26.447125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:33:26.447125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:33:26.447125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:33:26.447125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:33:26.447125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:33:26.447125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:33:26.447125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:33:26.447125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:33:26.447125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: May 19 12:33:26.447125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {"volumeAttachment": {"volumeId": "e96f1115-4319-4abf-85b4-d8c9d6344d1c"}} May 19 12:33:26.447125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Invalid volume: volume e96f1115-4319-4abf-85b4-d8c9d6344d1c is already attached to instances: 5bd02616-e81f-4372-89c1-8a9f63588512 May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'server_id': '5bd02616-e81f-4372-89c1-8a9f63588512', 'body': {'volumeAttachment': {'volumeId': 'e96f1115-4319-4abf-85b4-d8c9d6344d1c'}}} May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e96f1115-4319-4abf-85b4-d8c9d6344d1c is already attached to instances: 5bd02616-e81f-4372-89c1-8a9f63588512 May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:33:26.448025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e96f1115-4319-4abf-85b4-d8c9d6344d1c is already attached to instances: 5bd02616-e81f-4372-89c1-8a9f63588512 May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:33:26.449203 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:33:26.450438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:33:26.450438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:33:26.450438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:33:26.450438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e96f1115-4319-4abf-85b4-d8c9d6344d1c is already attached to instances: 5bd02616-e81f-4372-89c1-8a9f63588512 May 19 12:33:26.450438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:33:26.450438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a5288a65-bbdd-4313-b9ff-fc8e60f3483a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 400 to user: Invalid volume: volume e96f1115-4319-4abf-85b4-d8c9d6344d1c is already attached to instances: 5bd02616-e81f-4372-89c1-8a9f63588512 {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:33:26.450438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a5288a65-bbdd-4313-b9ff-fc8e60f3483a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "POST /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099047 May 19 12:33:26.450438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 491/943] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:33:26 2022] POST /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 12:33:26.508578 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c8da2ee1-e274-458a-8e44-8f8a081c8cb6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:26.509077 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c8da2ee1-e274-458a-8e44-8f8a081c8cb6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:26.515248 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c8da2ee1-e274-458a-8e44-8f8a081c8cb6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:26.515704 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c8da2ee1-e274-458a-8e44-8f8a081c8cb6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:26.516468 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c8da2ee1-e274-458a-8e44-8f8a081c8cb6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:26.516908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c8da2ee1-e274-458a-8e44-8f8a081c8cb6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:26.603531 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-c8da2ee1-e274-458a-8e44-8f8a081c8cb6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lazy-loading 'services' on Instance uuid 5bd02616-e81f-4372-89c1-8a9f63588512 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:33:26.837255 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c8da2ee1-e274-458a-8e44-8f8a081c8cb6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments/e96f1115-4319-4abf-85b4-d8c9d6344d1c" status: 202 len: 0 microversion: 2.1 time: 0.333123 May 19 12:33:26.837984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 453/944] 10.222.0.57 () {58 vars in 1415 bytes} [Thu May 19 12:33:26 2022] DELETE /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments/e96f1115-4319-4abf-85b4-d8c9d6344d1c => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:33:26.846967 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b8ca4efe-8ef7-4440-982f-895a6aa38238 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:26.847944 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b8ca4efe-8ef7-4440-982f-895a6aa38238 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:26.856217 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b8ca4efe-8ef7-4440-982f-895a6aa38238 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:26.856730 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b8ca4efe-8ef7-4440-982f-895a6aa38238 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:26.857499 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b8ca4efe-8ef7-4440-982f-895a6aa38238 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:26.857938 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b8ca4efe-8ef7-4440-982f-895a6aa38238 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:26.887277 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b8ca4efe-8ef7-4440-982f-895a6aa38238 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 May 19 12:33:26.887836 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 492/945] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:33:26 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:33:26.930722 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5c935bb7-56e8-43b7-8404-dcef8911a573 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:26.931436 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5c935bb7-56e8-43b7-8404-dcef8911a573 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:26.937809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c935bb7-56e8-43b7-8404-dcef8911a573 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:26.938255 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c935bb7-56e8-43b7-8404-dcef8911a573 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:26.939064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c935bb7-56e8-43b7-8404-dcef8911a573 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:26.939494 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5c935bb7-56e8-43b7-8404-dcef8911a573 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:27.072002 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5c935bb7-56e8-43b7-8404-dcef8911a573 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:27.080036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5c935bb7-56e8-43b7-8404-dcef8911a573 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:27.081528 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5c935bb7-56e8-43b7-8404-dcef8911a573 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:27.082701 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5c935bb7-56e8-43b7-8404-dcef8911a573 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1744 microversion: 2.20 time: 0.157402 May 19 12:33:27.083258 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 454/946] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:26 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:33:27.448129 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-ced53e04-38b2-4537-96c2-0812d2e70444 req-9062780d-a073-4def-9ef6-1072091ea432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366b434a-af2f-4b06-beda-5bb9b4816e66", "name": "network-vif-plugged", "status": "completed", "tag": "aa50357b-95ff-4657-bbc2-3b5dd21e899e"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:27.456623 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-ced53e04-38b2-4537-96c2-0812d2e70444 req-9062780d-a073-4def-9ef6-1072091ea432 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:27.457067 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-ced53e04-38b2-4537-96c2-0812d2e70444 req-9062780d-a073-4def-9ef6-1072091ea432 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:27.468425 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-ced53e04-38b2-4537-96c2-0812d2e70444 req-9062780d-a073-4def-9ef6-1072091ea432 service nova] Creating event network-vif-plugged:aa50357b-95ff-4657-bbc2-3b5dd21e899e for instance 366b434a-af2f-4b06-beda-5bb9b4816e66 on hv-cinder-77819 May 19 12:33:27.473814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-ced53e04-38b2-4537-96c2-0812d2e70444 req-9062780d-a073-4def-9ef6-1072091ea432 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029937 May 19 12:33:27.474392 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 493/947] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:33:27.899541 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-509bc45f-a530-4836-90fa-918a7c286808 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:27.900573 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-509bc45f-a530-4836-90fa-918a7c286808 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:27.907124 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-509bc45f-a530-4836-90fa-918a7c286808 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:27.926709 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-509bc45f-a530-4836-90fa-918a7c286808 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:27.926709 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-509bc45f-a530-4836-90fa-918a7c286808 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:27.926709 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-509bc45f-a530-4836-90fa-918a7c286808 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:27.926709 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:27.938567 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-509bc45f-a530-4836-90fa-918a7c286808 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 May 19 12:33:27.939125 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 455/948] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:33:27 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:33:28.102401 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0c51fd96-c2d2-4159-8b41-417eaf702a9a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:28.103113 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0c51fd96-c2d2-4159-8b41-417eaf702a9a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:28.109454 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0c51fd96-c2d2-4159-8b41-417eaf702a9a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:28.109904 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0c51fd96-c2d2-4159-8b41-417eaf702a9a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:28.110695 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0c51fd96-c2d2-4159-8b41-417eaf702a9a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:28.111129 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0c51fd96-c2d2-4159-8b41-417eaf702a9a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:28.246843 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0c51fd96-c2d2-4159-8b41-417eaf702a9a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:28.254539 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0c51fd96-c2d2-4159-8b41-417eaf702a9a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:28.256022 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0c51fd96-c2d2-4159-8b41-417eaf702a9a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:28.258028 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0c51fd96-c2d2-4159-8b41-417eaf702a9a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1744 microversion: 2.20 time: 0.160358 May 19 12:33:28.258643 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 494/949] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:28 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:28.950061 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ebcdd169-07d3-4390-a068-bf1505a67888 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:28.951052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ebcdd169-07d3-4390-a068-bf1505a67888 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:28.958116 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ebcdd169-07d3-4390-a068-bf1505a67888 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:28.958597 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ebcdd169-07d3-4390-a068-bf1505a67888 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:28.959398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ebcdd169-07d3-4390-a068-bf1505a67888 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:28.959833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ebcdd169-07d3-4390-a068-bf1505a67888 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:28.989605 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ebcdd169-07d3-4390-a068-bf1505a67888 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043442 May 19 12:33:28.990191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 456/950] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:33:28 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:33:29.277548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-53a1b8bd-9a37-4b0d-b5cf-bece0a91445e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:29.278172 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-53a1b8bd-9a37-4b0d-b5cf-bece0a91445e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:29.284236 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53a1b8bd-9a37-4b0d-b5cf-bece0a91445e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:29.284680 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53a1b8bd-9a37-4b0d-b5cf-bece0a91445e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:29.285436 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53a1b8bd-9a37-4b0d-b5cf-bece0a91445e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:29.285871 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53a1b8bd-9a37-4b0d-b5cf-bece0a91445e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:29.417254 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-53a1b8bd-9a37-4b0d-b5cf-bece0a91445e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:29.425315 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-53a1b8bd-9a37-4b0d-b5cf-bece0a91445e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:29.426839 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-53a1b8bd-9a37-4b0d-b5cf-bece0a91445e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:29.428012 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-53a1b8bd-9a37-4b0d-b5cf-bece0a91445e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1744 microversion: 2.20 time: 0.155302 May 19 12:33:29.429067 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 495/951] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:29 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:30.002186 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dd6649e7-83e1-47e1-89bb-99b251ebebcf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:30.003145 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dd6649e7-83e1-47e1-89bb-99b251ebebcf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:30.009752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dd6649e7-83e1-47e1-89bb-99b251ebebcf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:30.010197 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dd6649e7-83e1-47e1-89bb-99b251ebebcf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:30.010976 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dd6649e7-83e1-47e1-89bb-99b251ebebcf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:30.011410 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dd6649e7-83e1-47e1-89bb-99b251ebebcf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:30.040781 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dd6649e7-83e1-47e1-89bb-99b251ebebcf tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042918 May 19 12:33:30.041350 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 457/952] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:33:29 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:33:30.447445 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fe99a7b6-5cb3-413c-9bb7-8b9f38311480 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:30.448096 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fe99a7b6-5cb3-413c-9bb7-8b9f38311480 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:30.454546 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe99a7b6-5cb3-413c-9bb7-8b9f38311480 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:30.454995 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe99a7b6-5cb3-413c-9bb7-8b9f38311480 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:30.455749 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe99a7b6-5cb3-413c-9bb7-8b9f38311480 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:30.456180 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fe99a7b6-5cb3-413c-9bb7-8b9f38311480 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:30.592457 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fe99a7b6-5cb3-413c-9bb7-8b9f38311480 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:30.600455 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fe99a7b6-5cb3-413c-9bb7-8b9f38311480 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:30.602243 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fe99a7b6-5cb3-413c-9bb7-8b9f38311480 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:30.603432 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fe99a7b6-5cb3-413c-9bb7-8b9f38311480 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1744 microversion: 2.20 time: 0.160368 May 19 12:33:30.603990 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 496/953] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:30 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:31.052323 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-33ddaf13-3811-4138-b0db-a44642544eb2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:31.053252 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-33ddaf13-3811-4138-b0db-a44642544eb2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:31.061065 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-33ddaf13-3811-4138-b0db-a44642544eb2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:31.061517 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-33ddaf13-3811-4138-b0db-a44642544eb2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:31.062287 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-33ddaf13-3811-4138-b0db-a44642544eb2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:31.062755 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-33ddaf13-3811-4138-b0db-a44642544eb2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:31.092916 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-33ddaf13-3811-4138-b0db-a44642544eb2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 May 19 12:33:31.093482 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 458/954] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:33:31 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:33:31.621188 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e201c52c-046e-4531-ab72-9b5267a17e74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:31.621785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e201c52c-046e-4531-ab72-9b5267a17e74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:31.628247 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e201c52c-046e-4531-ab72-9b5267a17e74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:31.628690 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e201c52c-046e-4531-ab72-9b5267a17e74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:31.629445 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e201c52c-046e-4531-ab72-9b5267a17e74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:31.629878 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e201c52c-046e-4531-ab72-9b5267a17e74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:31.757037 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e201c52c-046e-4531-ab72-9b5267a17e74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:31.765249 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e201c52c-046e-4531-ab72-9b5267a17e74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:31.766816 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e201c52c-046e-4531-ab72-9b5267a17e74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:31.767976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e201c52c-046e-4531-ab72-9b5267a17e74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.150707 May 19 12:33:31.768543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 497/955] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:31 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:32.104680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-474cf9e4-3307-4599-bdbc-93e7dc9f91aa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:32.105602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-474cf9e4-3307-4599-bdbc-93e7dc9f91aa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:32.112176 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-474cf9e4-3307-4599-bdbc-93e7dc9f91aa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:32.112626 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-474cf9e4-3307-4599-bdbc-93e7dc9f91aa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:32.113392 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-474cf9e4-3307-4599-bdbc-93e7dc9f91aa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:32.113825 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-474cf9e4-3307-4599-bdbc-93e7dc9f91aa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:32.143577 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-474cf9e4-3307-4599-bdbc-93e7dc9f91aa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043006 May 19 12:33:32.144152 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 459/956] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:33:32 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:33:32.788581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5f1768eb-c7d3-4f81-90fa-2be748a2e56c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:32.789343 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5f1768eb-c7d3-4f81-90fa-2be748a2e56c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:32.795514 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f1768eb-c7d3-4f81-90fa-2be748a2e56c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:32.796005 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f1768eb-c7d3-4f81-90fa-2be748a2e56c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:32.796747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f1768eb-c7d3-4f81-90fa-2be748a2e56c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:32.797190 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f1768eb-c7d3-4f81-90fa-2be748a2e56c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:32.938448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5f1768eb-c7d3-4f81-90fa-2be748a2e56c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:32.947170 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5f1768eb-c7d3-4f81-90fa-2be748a2e56c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:32.948567 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5f1768eb-c7d3-4f81-90fa-2be748a2e56c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:32.949881 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5f1768eb-c7d3-4f81-90fa-2be748a2e56c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.165793 May 19 12:33:32.950448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 498/957] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:32 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:33.155244 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-016c1f7a-c6c9-44d7-91c5-93631d439d37 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:33.156172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-016c1f7a-c6c9-44d7-91c5-93631d439d37 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:33.163248 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-016c1f7a-c6c9-44d7-91c5-93631d439d37 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:33.163780 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-016c1f7a-c6c9-44d7-91c5-93631d439d37 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:33.164643 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-016c1f7a-c6c9-44d7-91c5-93631d439d37 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:33.165159 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-016c1f7a-c6c9-44d7-91c5-93631d439d37 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:33.197489 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-016c1f7a-c6c9-44d7-91c5-93631d439d37 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 May 19 12:33:33.198108 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 460/958] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:33:33 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:33:33.968475 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d3c5754c-91e2-4757-9045-07d069286eb6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:33.969868 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d3c5754c-91e2-4757-9045-07d069286eb6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:33.978134 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3c5754c-91e2-4757-9045-07d069286eb6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:33.978623 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3c5754c-91e2-4757-9045-07d069286eb6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:33.979439 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3c5754c-91e2-4757-9045-07d069286eb6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:33.979877 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d3c5754c-91e2-4757-9045-07d069286eb6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:34.007952 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:34.150891 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d3c5754c-91e2-4757-9045-07d069286eb6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:34.159188 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d3c5754c-91e2-4757-9045-07d069286eb6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:34.160842 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d3c5754c-91e2-4757-9045-07d069286eb6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:34.162012 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d3c5754c-91e2-4757-9045-07d069286eb6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.197470 May 19 12:33:34.162617 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 499/959] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:33 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:34.210094 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-21f67395-3442-4c09-ab9d-fb6488c3c61d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:34.211927 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-21f67395-3442-4c09-ab9d-fb6488c3c61d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:34.219340 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-21f67395-3442-4c09-ab9d-fb6488c3c61d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:34.220081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-21f67395-3442-4c09-ab9d-fb6488c3c61d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:34.221362 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-21f67395-3442-4c09-ab9d-fb6488c3c61d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:34.222008 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-21f67395-3442-4c09-ab9d-fb6488c3c61d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:34.257257 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-21f67395-3442-4c09-ab9d-fb6488c3c61d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051022 May 19 12:33:34.259186 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 461/960] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:33:34 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:33:34.342380 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6116d8f5-3186-4592-8b77-21899c09e9a7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:34.343145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6116d8f5-3186-4592-8b77-21899c09e9a7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:34.349726 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6116d8f5-3186-4592-8b77-21899c09e9a7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:34.350235 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6116d8f5-3186-4592-8b77-21899c09e9a7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:34.351041 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6116d8f5-3186-4592-8b77-21899c09e9a7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:34.351552 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6116d8f5-3186-4592-8b77-21899c09e9a7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:34.377990 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6116d8f5-3186-4592-8b77-21899c09e9a7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Going to try to terminate instance {{(pid=118112) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:33:34.746364 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6116d8f5-3186-4592-8b77-21899c09e9a7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 204 len: 0 microversion: 2.1 time: 0.407659 May 19 12:33:34.747245 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 500/961] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:33:34 2022] DELETE /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:33:34.756036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3b9ab18e-bf4d-4252-b865-5ba30f6452fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:34.756819 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3b9ab18e-bf4d-4252-b865-5ba30f6452fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:34.764382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3b9ab18e-bf4d-4252-b865-5ba30f6452fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:34.764843 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3b9ab18e-bf4d-4252-b865-5ba30f6452fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:34.765622 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3b9ab18e-bf4d-4252-b865-5ba30f6452fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:34.766257 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3b9ab18e-bf4d-4252-b865-5ba30f6452fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:34.928273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3b9ab18e-bf4d-4252-b865-5ba30f6452fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:34.939187 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3b9ab18e-bf4d-4252-b865-5ba30f6452fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1683 microversion: 2.1 time: 0.186935 May 19 12:33:34.939963 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 462/962] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:34 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:35.183627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6f95db8d-1c45-4e52-85dd-f0eaf03b920b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:35.184347 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6f95db8d-1c45-4e52-85dd-f0eaf03b920b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:35.191136 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6f95db8d-1c45-4e52-85dd-f0eaf03b920b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:35.191873 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6f95db8d-1c45-4e52-85dd-f0eaf03b920b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:35.193049 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6f95db8d-1c45-4e52-85dd-f0eaf03b920b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:35.193665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6f95db8d-1c45-4e52-85dd-f0eaf03b920b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:35.356140 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6f95db8d-1c45-4e52-85dd-f0eaf03b920b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:35.369502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6f95db8d-1c45-4e52-85dd-f0eaf03b920b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:35.371279 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6f95db8d-1c45-4e52-85dd-f0eaf03b920b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:35.372822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6f95db8d-1c45-4e52-85dd-f0eaf03b920b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.194176 May 19 12:33:35.373489 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 501/963] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:35 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:35.956695 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-34446724-e72a-4920-997c-f3a5cc372895 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:35.957311 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-34446724-e72a-4920-997c-f3a5cc372895 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:35.964585 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-34446724-e72a-4920-997c-f3a5cc372895 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:35.965310 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-34446724-e72a-4920-997c-f3a5cc372895 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:35.966085 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-34446724-e72a-4920-997c-f3a5cc372895 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:35.966784 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-34446724-e72a-4920-997c-f3a5cc372895 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:36.134840 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-34446724-e72a-4920-997c-f3a5cc372895 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:36.142973 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-34446724-e72a-4920-997c-f3a5cc372895 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1683 microversion: 2.1 time: 0.190244 May 19 12:33:36.143571 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 463/964] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:35 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:36.392526 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-84ccd5a4-55f5-43aa-ba4d-383703b26247 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:36.393182 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-84ccd5a4-55f5-43aa-ba4d-383703b26247 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:36.400623 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-84ccd5a4-55f5-43aa-ba4d-383703b26247 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:36.401076 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-84ccd5a4-55f5-43aa-ba4d-383703b26247 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:36.401853 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-84ccd5a4-55f5-43aa-ba4d-383703b26247 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:36.402287 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-84ccd5a4-55f5-43aa-ba4d-383703b26247 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:36.552606 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-84ccd5a4-55f5-43aa-ba4d-383703b26247 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:36.562309 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-84ccd5a4-55f5-43aa-ba4d-383703b26247 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:36.563832 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-84ccd5a4-55f5-43aa-ba4d-383703b26247 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:36.564998 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-84ccd5a4-55f5-43aa-ba4d-383703b26247 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.176575 May 19 12:33:36.565565 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 502/965] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:36 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:37.159556 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fbcc3604-7730-47a3-9c51-097dfe25eb99 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:37.160278 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fbcc3604-7730-47a3-9c51-097dfe25eb99 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:37.169633 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fbcc3604-7730-47a3-9c51-097dfe25eb99 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:37.170181 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fbcc3604-7730-47a3-9c51-097dfe25eb99 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:37.171789 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fbcc3604-7730-47a3-9c51-097dfe25eb99 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:37.172531 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fbcc3604-7730-47a3-9c51-097dfe25eb99 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:37.343271 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-fbcc3604-7730-47a3-9c51-097dfe25eb99 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:37.356008 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fbcc3604-7730-47a3-9c51-097dfe25eb99 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1683 microversion: 2.1 time: 0.200264 May 19 12:33:37.357630 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 464/966] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:37 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1683 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:37.584389 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1c7e3379-3739-4f2d-971d-25e023eddd84 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:37.585601 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1c7e3379-3739-4f2d-971d-25e023eddd84 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:37.595536 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1c7e3379-3739-4f2d-971d-25e023eddd84 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:37.596274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1c7e3379-3739-4f2d-971d-25e023eddd84 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:37.597061 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1c7e3379-3739-4f2d-971d-25e023eddd84 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:37.597498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1c7e3379-3739-4f2d-971d-25e023eddd84 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:37.765106 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1c7e3379-3739-4f2d-971d-25e023eddd84 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:37.778148 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1c7e3379-3739-4f2d-971d-25e023eddd84 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:37.779711 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-1c7e3379-3739-4f2d-971d-25e023eddd84 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:37.780881 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1c7e3379-3739-4f2d-971d-25e023eddd84 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.200792 May 19 12:33:37.781885 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 503/967] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:37 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:38.373783 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f42fa419-b519-46c2-bae2-37d7626c58d7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:38.374706 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f42fa419-b519-46c2-bae2-37d7626c58d7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:38.381505 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f42fa419-b519-46c2-bae2-37d7626c58d7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:38.382045 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f42fa419-b519-46c2-bae2-37d7626c58d7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:38.383014 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f42fa419-b519-46c2-bae2-37d7626c58d7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:38.383462 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f42fa419-b519-46c2-bae2-37d7626c58d7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:38.520409 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f42fa419-b519-46c2-bae2-37d7626c58d7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:38.530013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f42fa419-b519-46c2-bae2-37d7626c58d7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1683 microversion: 2.1 time: 0.159917 May 19 12:33:38.530624 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 465/968] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:38 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:38.800599 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b0aaa13f-9b09-4c5c-b22a-e55397e17abd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:38.801150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b0aaa13f-9b09-4c5c-b22a-e55397e17abd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:38.808329 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b0aaa13f-9b09-4c5c-b22a-e55397e17abd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:38.808779 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b0aaa13f-9b09-4c5c-b22a-e55397e17abd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:38.809581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b0aaa13f-9b09-4c5c-b22a-e55397e17abd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:38.810027 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b0aaa13f-9b09-4c5c-b22a-e55397e17abd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:38.944603 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b0aaa13f-9b09-4c5c-b22a-e55397e17abd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:38.953252 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b0aaa13f-9b09-4c5c-b22a-e55397e17abd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:38.955309 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b0aaa13f-9b09-4c5c-b22a-e55397e17abd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:38.955896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b0aaa13f-9b09-4c5c-b22a-e55397e17abd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.159399 May 19 12:33:38.956453 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 504/969] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:38 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:39.548873 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-71717814-02ad-4673-b69d-68549e658106 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:39.549492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-71717814-02ad-4673-b69d-68549e658106 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:39.556830 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-71717814-02ad-4673-b69d-68549e658106 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:39.557283 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-71717814-02ad-4673-b69d-68549e658106 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:39.558064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-71717814-02ad-4673-b69d-68549e658106 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:39.558530 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-71717814-02ad-4673-b69d-68549e658106 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:39.713499 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-71717814-02ad-4673-b69d-68549e658106 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:39.721790 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-71717814-02ad-4673-b69d-68549e658106 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1683 microversion: 2.1 time: 0.177418 May 19 12:33:39.722597 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 466/970] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:39 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:39.977088 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c0ffd3e2-445a-4acc-8529-3c1733109b2c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:39.978386 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c0ffd3e2-445a-4acc-8529-3c1733109b2c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:39.985701 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c0ffd3e2-445a-4acc-8529-3c1733109b2c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:39.987892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c0ffd3e2-445a-4acc-8529-3c1733109b2c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:39.987892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c0ffd3e2-445a-4acc-8529-3c1733109b2c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:39.987892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c0ffd3e2-445a-4acc-8529-3c1733109b2c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:40.128577 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c0ffd3e2-445a-4acc-8529-3c1733109b2c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:40.139466 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c0ffd3e2-445a-4acc-8529-3c1733109b2c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:40.141140 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c0ffd3e2-445a-4acc-8529-3c1733109b2c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:40.142328 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c0ffd3e2-445a-4acc-8529-3c1733109b2c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.172008 May 19 12:33:40.142919 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 505/971] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:39 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:33:40.741666 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a9420ee3-fd77-41d5-a76c-04625b2baa6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:40.742296 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a9420ee3-fd77-41d5-a76c-04625b2baa6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:40.753464 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a9420ee3-fd77-41d5-a76c-04625b2baa6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:40.757683 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a9420ee3-fd77-41d5-a76c-04625b2baa6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:40.757683 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a9420ee3-fd77-41d5-a76c-04625b2baa6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:40.757683 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a9420ee3-fd77-41d5-a76c-04625b2baa6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:41.035971 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a9420ee3-fd77-41d5-a76c-04625b2baa6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:41.044637 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a9420ee3-fd77-41d5-a76c-04625b2baa6c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1683 microversion: 2.1 time: 0.307187 May 19 12:33:41.045320 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 467/972] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:40 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1683 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:41.166034 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-29e49bc7-bf8c-4f82-a86c-d5258d481d05 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:41.166034 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-29e49bc7-bf8c-4f82-a86c-d5258d481d05 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:41.169546 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29e49bc7-bf8c-4f82-a86c-d5258d481d05 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:41.170021 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29e49bc7-bf8c-4f82-a86c-d5258d481d05 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:41.170822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29e49bc7-bf8c-4f82-a86c-d5258d481d05 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:41.171401 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29e49bc7-bf8c-4f82-a86c-d5258d481d05 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:41.314815 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-29e49bc7-bf8c-4f82-a86c-d5258d481d05 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:41.325670 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-29e49bc7-bf8c-4f82-a86c-d5258d481d05 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:41.328408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-29e49bc7-bf8c-4f82-a86c-d5258d481d05 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:41.329950 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-29e49bc7-bf8c-4f82-a86c-d5258d481d05 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.172463 May 19 12:33:41.342865 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 506/973] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:41 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:41.777746 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-4c67f8eb-0410-4fc9-bca1-97455dec30b8 req-c3e42ff5-5fbe-48bf-828c-a2c15b2f8eca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd02616-e81f-4372-89c1-8a9f63588512", "name": "network-vif-deleted", "tag": "b000d5e8-7d43-43d1-b1d5-88228f892e8f"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:41.796996 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=49 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:41.803355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4c67f8eb-0410-4fc9-bca1-97455dec30b8 req-c3e42ff5-5fbe-48bf-828c-a2c15b2f8eca service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:41.803815 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-4c67f8eb-0410-4fc9-bca1-97455dec30b8 req-c3e42ff5-5fbe-48bf-828c-a2c15b2f8eca service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:41.819147 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-4c67f8eb-0410-4fc9-bca1-97455dec30b8 req-c3e42ff5-5fbe-48bf-828c-a2c15b2f8eca service nova] Creating event network-vif-deleted:b000d5e8-7d43-43d1-b1d5-88228f892e8f for instance 5bd02616-e81f-4372-89c1-8a9f63588512 on hv-cinder-77819 May 19 12:33:41.827021 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-4c67f8eb-0410-4fc9-bca1-97455dec30b8 req-c3e42ff5-5fbe-48bf-828c-a2c15b2f8eca service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054854 May 19 12:33:41.829121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 468/974] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:33:42.064251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d5f7b8e8-7c4e-4a05-8fcb-1a2c9bd979b5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:42.065340 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d5f7b8e8-7c4e-4a05-8fcb-1a2c9bd979b5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:42.071891 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:42.073856 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5f7b8e8-7c4e-4a05-8fcb-1a2c9bd979b5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:42.074620 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5f7b8e8-7c4e-4a05-8fcb-1a2c9bd979b5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:42.076250 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5f7b8e8-7c4e-4a05-8fcb-1a2c9bd979b5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:42.076869 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d5f7b8e8-7c4e-4a05-8fcb-1a2c9bd979b5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:42.160233 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d5f7b8e8-7c4e-4a05-8fcb-1a2c9bd979b5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:42.170983 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d5f7b8e8-7c4e-4a05-8fcb-1a2c9bd979b5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1326 microversion: 2.1 time: 0.110871 May 19 12:33:42.172637 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 507/975] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:42 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1326 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:42.351124 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-db08a198-735f-43b2-9dcc-d2d4f786585f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:42.353278 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-db08a198-735f-43b2-9dcc-d2d4f786585f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:42.360004 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-db08a198-735f-43b2-9dcc-d2d4f786585f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:42.360758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-db08a198-735f-43b2-9dcc-d2d4f786585f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:42.362249 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-db08a198-735f-43b2-9dcc-d2d4f786585f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:42.363251 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-db08a198-735f-43b2-9dcc-d2d4f786585f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:42.568933 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-db08a198-735f-43b2-9dcc-d2d4f786585f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:42.578280 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-db08a198-735f-43b2-9dcc-d2d4f786585f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:42.579780 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-db08a198-735f-43b2-9dcc-d2d4f786585f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:42.581166 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-db08a198-735f-43b2-9dcc-d2d4f786585f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.234711 May 19 12:33:42.581721 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 469/976] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:42 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:33:43.189397 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b93f940d-f018-4135-b0a5-43fb199cb4f1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:43.190181 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b93f940d-f018-4135-b0a5-43fb199cb4f1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:43.198034 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b93f940d-f018-4135-b0a5-43fb199cb4f1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:43.198674 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b93f940d-f018-4135-b0a5-43fb199cb4f1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:43.199778 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b93f940d-f018-4135-b0a5-43fb199cb4f1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:43.200487 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b93f940d-f018-4135-b0a5-43fb199cb4f1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:43.235293 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b93f940d-f018-4135-b0a5-43fb199cb4f1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:43.235999 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b93f940d-f018-4135-b0a5-43fb199cb4f1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:43.236628 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-b93f940d-f018-4135-b0a5-43fb199cb4f1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lazy-loading 'fault' on Instance uuid 5bd02616-e81f-4372-89c1-8a9f63588512 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:33:43.292147 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b93f940d-f018-4135-b0a5-43fb199cb4f1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:43.300991 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b93f940d-f018-4135-b0a5-43fb199cb4f1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1331 microversion: 2.1 time: 0.115500 May 19 12:33:43.301574 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 508/977] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:43 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:43.603726 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e189f5cb-0b09-4304-9486-7c939120631f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:43.604533 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e189f5cb-0b09-4304-9486-7c939120631f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:43.614078 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e189f5cb-0b09-4304-9486-7c939120631f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:43.614652 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e189f5cb-0b09-4304-9486-7c939120631f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:43.616883 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e189f5cb-0b09-4304-9486-7c939120631f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:43.616883 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e189f5cb-0b09-4304-9486-7c939120631f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:43.790778 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e189f5cb-0b09-4304-9486-7c939120631f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:43.806742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e189f5cb-0b09-4304-9486-7c939120631f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:43.806742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e189f5cb-0b09-4304-9486-7c939120631f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:43.815670 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e189f5cb-0b09-4304-9486-7c939120631f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.207307 May 19 12:33:43.816775 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 470/978] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:43 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:44.319222 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b746648b-2753-4fca-bf4b-bc56432b39a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:44.319855 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b746648b-2753-4fca-bf4b-bc56432b39a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:44.327923 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b746648b-2753-4fca-bf4b-bc56432b39a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:44.328350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b746648b-2753-4fca-bf4b-bc56432b39a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:44.329124 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b746648b-2753-4fca-bf4b-bc56432b39a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:44.329560 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b746648b-2753-4fca-bf4b-bc56432b39a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:44.365883 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b746648b-2753-4fca-bf4b-bc56432b39a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:44.366327 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b746648b-2753-4fca-bf4b-bc56432b39a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:44.366818 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-b746648b-2753-4fca-bf4b-bc56432b39a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lazy-loading 'fault' on Instance uuid 5bd02616-e81f-4372-89c1-8a9f63588512 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:33:44.407818 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b746648b-2753-4fca-bf4b-bc56432b39a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:44.415438 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b746648b-2753-4fca-bf4b-bc56432b39a2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1331 microversion: 2.1 time: 0.100065 May 19 12:33:44.416025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 509/979] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:44 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:44.836259 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-068898fb-2c95-4592-ac3b-d8d5cf18eb60 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:44.837883 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-068898fb-2c95-4592-ac3b-d8d5cf18eb60 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:44.845183 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-068898fb-2c95-4592-ac3b-d8d5cf18eb60 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:44.845936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-068898fb-2c95-4592-ac3b-d8d5cf18eb60 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:44.846963 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-068898fb-2c95-4592-ac3b-d8d5cf18eb60 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:44.847623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-068898fb-2c95-4592-ac3b-d8d5cf18eb60 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:44.997239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-068898fb-2c95-4592-ac3b-d8d5cf18eb60 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:45.005797 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-068898fb-2c95-4592-ac3b-d8d5cf18eb60 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:45.007392 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-068898fb-2c95-4592-ac3b-d8d5cf18eb60 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:45.008653 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-068898fb-2c95-4592-ac3b-d8d5cf18eb60 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.176855 May 19 12:33:45.010546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 471/980] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:44 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:33:45.432741 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fc8b3903-0d37-44b0-824d-ff39acb5e36a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:45.433358 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fc8b3903-0d37-44b0-824d-ff39acb5e36a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:45.440090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc8b3903-0d37-44b0-824d-ff39acb5e36a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:45.440479 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc8b3903-0d37-44b0-824d-ff39acb5e36a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:45.441265 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc8b3903-0d37-44b0-824d-ff39acb5e36a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:45.441703 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc8b3903-0d37-44b0-824d-ff39acb5e36a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:45.475554 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc8b3903-0d37-44b0-824d-ff39acb5e36a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:45.475998 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fc8b3903-0d37-44b0-824d-ff39acb5e36a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:45.476452 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-fc8b3903-0d37-44b0-824d-ff39acb5e36a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lazy-loading 'fault' on Instance uuid 5bd02616-e81f-4372-89c1-8a9f63588512 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:33:45.516913 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fc8b3903-0d37-44b0-824d-ff39acb5e36a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:45.525217 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fc8b3903-0d37-44b0-824d-ff39acb5e36a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1331 microversion: 2.1 time: 0.096718 May 19 12:33:45.525724 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 510/981] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:45 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:45.538646 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a59fb2bb-2688-44a6-9897-e0fd314d34bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:45.539139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a59fb2bb-2688-44a6-9897-e0fd314d34bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:45.545414 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a59fb2bb-2688-44a6-9897-e0fd314d34bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:45.546390 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a59fb2bb-2688-44a6-9897-e0fd314d34bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:45.547120 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a59fb2bb-2688-44a6-9897-e0fd314d34bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:45.548035 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a59fb2bb-2688-44a6-9897-e0fd314d34bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:45.573048 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a59fb2bb-2688-44a6-9897-e0fd314d34bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/ips" status: 200 len: 145 microversion: 2.1 time: 0.038196 May 19 12:33:45.580929 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 472/982] 10.222.0.57 () {58 vars in 1247 bytes} [Thu May 19 12:33:45 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:33:46.029835 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f8edf8b3-7fb8-4d55-89a0-ba2d03804a17 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:46.030613 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f8edf8b3-7fb8-4d55-89a0-ba2d03804a17 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:46.036792 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8edf8b3-7fb8-4d55-89a0-ba2d03804a17 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:46.037241 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8edf8b3-7fb8-4d55-89a0-ba2d03804a17 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:46.038003 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8edf8b3-7fb8-4d55-89a0-ba2d03804a17 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:46.038464 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8edf8b3-7fb8-4d55-89a0-ba2d03804a17 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:46.177881 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f8edf8b3-7fb8-4d55-89a0-ba2d03804a17 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:46.187119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f8edf8b3-7fb8-4d55-89a0-ba2d03804a17 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:46.188653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f8edf8b3-7fb8-4d55-89a0-ba2d03804a17 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:46.189837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f8edf8b3-7fb8-4d55-89a0-ba2d03804a17 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.166932 May 19 12:33:46.190429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 511/983] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:46 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:46.542755 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ad8a5cd2-70fb-430a-ab4c-309c24f658cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:46.542755 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ad8a5cd2-70fb-430a-ab4c-309c24f658cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:46.550563 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad8a5cd2-70fb-430a-ab4c-309c24f658cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:46.550563 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad8a5cd2-70fb-430a-ab4c-309c24f658cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:46.551308 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad8a5cd2-70fb-430a-ab4c-309c24f658cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:46.551744 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad8a5cd2-70fb-430a-ab4c-309c24f658cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:46.556492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=100 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:46.583811 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad8a5cd2-70fb-430a-ab4c-309c24f658cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:46.584258 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ad8a5cd2-70fb-430a-ab4c-309c24f658cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:46.584702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-ad8a5cd2-70fb-430a-ab4c-309c24f658cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lazy-loading 'fault' on Instance uuid 5bd02616-e81f-4372-89c1-8a9f63588512 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:33:46.632449 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ad8a5cd2-70fb-430a-ab4c-309c24f658cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:46.642574 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ad8a5cd2-70fb-430a-ab4c-309c24f658cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 200 len: 1331 microversion: 2.1 time: 0.104015 May 19 12:33:46.643265 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 473/984] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:46 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:47.208936 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5f0c4bb5-bb9e-49c7-8e2b-e58840abde06 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:47.209525 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5f0c4bb5-bb9e-49c7-8e2b-e58840abde06 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:47.217042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f0c4bb5-bb9e-49c7-8e2b-e58840abde06 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:47.217494 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f0c4bb5-bb9e-49c7-8e2b-e58840abde06 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:47.218261 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f0c4bb5-bb9e-49c7-8e2b-e58840abde06 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:47.218732 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5f0c4bb5-bb9e-49c7-8e2b-e58840abde06 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:47.349050 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5f0c4bb5-bb9e-49c7-8e2b-e58840abde06 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:47.356985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5f0c4bb5-bb9e-49c7-8e2b-e58840abde06 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:47.358477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5f0c4bb5-bb9e-49c7-8e2b-e58840abde06 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:47.359658 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5f0c4bb5-bb9e-49c7-8e2b-e58840abde06 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1739 microversion: 2.20 time: 0.154726 May 19 12:33:47.360221 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 512/985] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:47 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:47.660462 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3b16215c-6c7d-4055-9c59-7f1ce1fdddea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:47.661174 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3b16215c-6c7d-4055-9c59-7f1ce1fdddea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:47.668975 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3b16215c-6c7d-4055-9c59-7f1ce1fdddea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:47.669427 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3b16215c-6c7d-4055-9c59-7f1ce1fdddea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:47.670202 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3b16215c-6c7d-4055-9c59-7f1ce1fdddea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:47.670778 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3b16215c-6c7d-4055-9c59-7f1ce1fdddea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:47.689483 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-3b16215c-6c7d-4055-9c59-7f1ce1fdddea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3b16215c-6c7d-4055-9c59-7f1ce1fdddea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 HTTP/1.1 May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:33:47.691233 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:33:47.693539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:33:47.693539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:33:47.693539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:33:47.693539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:33:47.693539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:33:47.693539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:33:47.693539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:33:47.693539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:33:47.693539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:33:47.693539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:33:47.693539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:33:47.693539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '5bd02616-e81f-4372-89c1-8a9f63588512'} May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:33:47.694502 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:33:47.698616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:33:47.700205 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3b16215c-6c7d-4055-9c59-7f1ce1fdddea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 404 to user: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:33:47.700205 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3b16215c-6c7d-4055-9c59-7f1ce1fdddea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 404 len: 111 microversion: 2.1 time: 0.036376 May 19 12:33:47.700205 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 474/986] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:47 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:33:47.709176 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3bf5fd90-1217-4194-b1c5-cd22e0dab305 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '.version_select at 0x7fd45779df70>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:47.712615 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3bf5fd90-1217-4194-b1c5-cd22e0dab305 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [d6827b1e-5312-4338-b73f-7352bfc4cf3d] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 12:33:48.182117 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a5819806-f7c8-49b4-9387-74654ef8aed9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7f062ec-b2b4-4543-bd8e-4619b9b00258"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:48.183312 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a5819806-f7c8-49b4-9387-74654ef8aed9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:48.189578 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a5819806-f7c8-49b4-9387-74654ef8aed9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:48.190029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a5819806-f7c8-49b4-9387-74654ef8aed9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:48.190836 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a5819806-f7c8-49b4-9387-74654ef8aed9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:48.191272 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a5819806-f7c8-49b4-9387-74654ef8aed9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:48.720309 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO oslo.messaging._drivers.impl_rabbit [None req-3bf5fd90-1217-4194-b1c5-cd22e0dab305 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [d6827b1e-5312-4338-b73f-7352bfc4cf3d] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 34596. May 19 12:33:48.815660 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3bf5fd90-1217-4194-b1c5-cd22e0dab305 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257794112" status: 202 len: 0 microversion: 2.1 time: 1.110121 May 19 12:33:48.816249 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 513/987] 10.222.0.57 () {58 vars in 1220 bytes} [Thu May 19 12:33:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1257794112 => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:33:48.821496 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8246fe96-ba14-4291-a99e-1474176bec88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:48.822104 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8246fe96-ba14-4291-a99e-1474176bec88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:48.829251 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8246fe96-ba14-4291-a99e-1474176bec88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:48.829710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8246fe96-ba14-4291-a99e-1474176bec88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:48.830521 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8246fe96-ba14-4291-a99e-1474176bec88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:48.830959 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8246fe96-ba14-4291-a99e-1474176bec88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:48.849983 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:33:49.018437 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8246fe96-ba14-4291-a99e-1474176bec88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:49.034511 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8246fe96-ba14-4291-a99e-1474176bec88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:49.037161 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8246fe96-ba14-4291-a99e-1474176bec88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:49.040098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8246fe96-ba14-4291-a99e-1474176bec88 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1721 microversion: 2.20 time: 0.221948 May 19 12:33:49.040677 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 514/988] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:48 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:49.683816 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-333335df-d68c-4cd5-b6a7-55c77d376700 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Action: 'create', calling method: .version_select at 0x7fd4560a7940>, body: {"keypair": {"name": "tempest-keypair-558420619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbEKrGb2uY7sB/Y4SWrtk3R7AVhODQiNwNl16v19BAN2FueJzR6Zr3dupEXuMVoxZ8X7KpXcQ/2PAxw+DUVV02CuAwZd/7vDSbFnn4ZlnhVVitloe8XXAQJG+qh25TTgQ=="}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:49.698209 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-333335df-d68c-4cd5-b6a7-55c77d376700 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for project 86c353f6ded643e6b501ec57800fafc6. Resources: {'key_pairs'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:33:49.702072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-333335df-d68c-4cd5-b6a7-55c77d376700 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for user f0a98f1c068843a684f6765d41cc4e49 and project 86c353f6ded643e6b501ec57800fafc6. Resources: {'key_pairs'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:33:49.809992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-333335df-d68c-4cd5-b6a7-55c77d376700 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130343 May 19 12:33:49.810709 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 515/989] 10.222.0.57 () {60 vars in 1158 bytes} [Thu May 19 12:33:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:33:50.059550 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ac357cc9-c7d5-4af6-b421-078d074e391e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:50.060149 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ac357cc9-c7d5-4af6-b421-078d074e391e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:50.066519 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ac357cc9-c7d5-4af6-b421-078d074e391e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:50.066979 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ac357cc9-c7d5-4af6-b421-078d074e391e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:50.067764 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ac357cc9-c7d5-4af6-b421-078d074e391e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:50.068202 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ac357cc9-c7d5-4af6-b421-078d074e391e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:50.204136 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ac357cc9-c7d5-4af6-b421-078d074e391e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:50.212814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ac357cc9-c7d5-4af6-b421-078d074e391e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:50.214505 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ac357cc9-c7d5-4af6-b421-078d074e391e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:50.215667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ac357cc9-c7d5-4af6-b421-078d074e391e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1721 microversion: 2.20 time: 0.161132 May 19 12:33:50.216215 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 516/990] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:50 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:33:50.455685 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-48d0d5be-315e-45e0-a7c2-00d29d8c84e6 req-731aaace-6c8e-42f0-bf92-74219e4fe867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366b434a-af2f-4b06-beda-5bb9b4816e66", "name": "network-vif-unplugged", "status": "completed", "tag": "aa50357b-95ff-4657-bbc2-3b5dd21e899e"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:50.467810 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-48d0d5be-315e-45e0-a7c2-00d29d8c84e6 req-731aaace-6c8e-42f0-bf92-74219e4fe867 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:50.468452 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-48d0d5be-315e-45e0-a7c2-00d29d8c84e6 req-731aaace-6c8e-42f0-bf92-74219e4fe867 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:50.481713 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-48d0d5be-315e-45e0-a7c2-00d29d8c84e6 req-731aaace-6c8e-42f0-bf92-74219e4fe867 service nova] Creating event network-vif-unplugged:aa50357b-95ff-4657-bbc2-3b5dd21e899e for instance 366b434a-af2f-4b06-beda-5bb9b4816e66 on hv-cinder-77819 May 19 12:33:50.486964 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-48d0d5be-315e-45e0-a7c2-00d29d8c84e6 req-731aaace-6c8e-42f0-bf92-74219e4fe867 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035295 May 19 12:33:50.487560 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 517/991] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:33:51.092726 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a5819806-f7c8-49b4-9387-74654ef8aed9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "POST /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.915050 May 19 12:33:51.093590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 475/992] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:33:48 2022] POST /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments => generated 194 bytes in 2917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:33:51.236309 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-30c690a4-f899-470e-85ec-ab0a7f51a222 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:51.236940 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-30c690a4-f899-470e-85ec-ab0a7f51a222 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:51.245348 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-30c690a4-f899-470e-85ec-ab0a7f51a222 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:51.245805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-30c690a4-f899-470e-85ec-ab0a7f51a222 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:51.246678 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-30c690a4-f899-470e-85ec-ab0a7f51a222 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:51.247120 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-30c690a4-f899-470e-85ec-ab0a7f51a222 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:51.404653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-30c690a4-f899-470e-85ec-ab0a7f51a222 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:51.413042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-30c690a4-f899-470e-85ec-ab0a7f51a222 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:51.414645 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-30c690a4-f899-470e-85ec-ab0a7f51a222 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:51.416689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-30c690a4-f899-470e-85ec-ab0a7f51a222 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1721 microversion: 2.20 time: 0.184722 May 19 12:33:51.417650 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 518/993] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:51 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:52.133190 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-680563775", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c9b89124-2c1b-4572-adaf-f3ca44cc01f0"}], "security_groups": [{"name": "tempest-securitygroup--2123566988"}], "key_name": "tempest-keypair-558420619", "user_data": "}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:52.239949 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] validate_networks() for [('c9b89124-2c1b-4572-adaf-f3ca44cc01f0', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:33:52.435971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-58b473d0-510b-46bf-aef7-686c971a6ce2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:52.436561 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-58b473d0-510b-46bf-aef7-686c971a6ce2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:52.443214 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-58b473d0-510b-46bf-aef7-686c971a6ce2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:52.443653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-58b473d0-510b-46bf-aef7-686c971a6ce2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:52.444440 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-58b473d0-510b-46bf-aef7-686c971a6ce2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:52.444851 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-58b473d0-510b-46bf-aef7-686c971a6ce2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:52.900705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-58b473d0-510b-46bf-aef7-686c971a6ce2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:52.909402 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-58b473d0-510b-46bf-aef7-686c971a6ce2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:52.911009 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-58b473d0-510b-46bf-aef7-686c971a6ce2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:52.912261 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-58b473d0-510b-46bf-aef7-686c971a6ce2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1721 microversion: 2.20 time: 0.480853 May 19 12:33:52.912894 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 519/994] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:52 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1721 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:33:52.930316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:33:52.930785 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:33:52.931277 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:33:52.931687 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:33:52.932093 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:33:52.941329 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:52.941772 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:52.942604 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:52.943044 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:52.960388 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for project 86c353f6ded643e6b501ec57800fafc6. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:33:52.965438 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Getting quotas for user f0a98f1c068843a684f6765d41cc4e49 and project 86c353f6ded643e6b501ec57800fafc6. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:33:52.976318 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:33:52.978691 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:33:53.091562 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7111fd79-88b9-4255-90af-c5be97fa2cde tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.964279 May 19 12:33:53.092276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 476/995] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:33:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:33:53.102073 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-70755677-c36a-4cac-9e46-515720acc5c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:53.102706 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-70755677-c36a-4cac-9e46-515720acc5c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:53.158545 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-70755677-c36a-4cac-9e46-515720acc5c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:53.165244 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-70755677-c36a-4cac-9e46-515720acc5c0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1240 microversion: 2.1 time: 0.066927 May 19 12:33:53.165829 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 520/996] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:53 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:53.930803 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7b280cd6-de4b-44b8-8768-19c7644a3a14 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:53.931414 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7b280cd6-de4b-44b8-8768-19c7644a3a14 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:53.939398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b280cd6-de4b-44b8-8768-19c7644a3a14 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:53.939851 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b280cd6-de4b-44b8-8768-19c7644a3a14 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:53.940620 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b280cd6-de4b-44b8-8768-19c7644a3a14 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:53.941054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7b280cd6-de4b-44b8-8768-19c7644a3a14 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:54.080296 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7b280cd6-de4b-44b8-8768-19c7644a3a14 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:54.088565 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7b280cd6-de4b-44b8-8768-19c7644a3a14 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:54.090893 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7b280cd6-de4b-44b8-8768-19c7644a3a14 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:54.092051 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7b280cd6-de4b-44b8-8768-19c7644a3a14 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1721 microversion: 2.20 time: 0.165991 May 19 12:33:54.092588 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 477/997] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:53 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:54.182456 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-028c8f72-72d3-46c6-808f-2fc37839a68a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:54.183146 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-028c8f72-72d3-46c6-808f-2fc37839a68a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:54.238675 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-028c8f72-72d3-46c6-808f-2fc37839a68a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:54.246202 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-028c8f72-72d3-46c6-808f-2fc37839a68a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1240 microversion: 2.1 time: 0.067750 May 19 12:33:54.246746 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 521/998] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:54 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:55.112733 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6f5dfd56-248c-4adc-a993-79b885816566 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:55.113812 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6f5dfd56-248c-4adc-a993-79b885816566 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:55.123730 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f5dfd56-248c-4adc-a993-79b885816566 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:55.124177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f5dfd56-248c-4adc-a993-79b885816566 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:55.124960 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f5dfd56-248c-4adc-a993-79b885816566 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:55.125402 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f5dfd56-248c-4adc-a993-79b885816566 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:55.263890 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-321d3320-7c6a-43fd-8389-b40b8a24e6c7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:55.264503 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-321d3320-7c6a-43fd-8389-b40b8a24e6c7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:55.271406 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6f5dfd56-248c-4adc-a993-79b885816566 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:55.280450 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6f5dfd56-248c-4adc-a993-79b885816566 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:55.282079 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6f5dfd56-248c-4adc-a993-79b885816566 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:55.283281 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6f5dfd56-248c-4adc-a993-79b885816566 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1664 microversion: 2.20 time: 0.176255 May 19 12:33:55.284023 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 478/999] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:55 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1664 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:55.307058 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-35cd1a0b-39fe-4322-8273-90b68313946c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfa67be6-9ec5-4c66-bb40-d4a6b6abeb9d"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:55.308863 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-35cd1a0b-39fe-4322-8273-90b68313946c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:55.315059 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-35cd1a0b-39fe-4322-8273-90b68313946c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:55.315506 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-35cd1a0b-39fe-4322-8273-90b68313946c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:55.316277 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-35cd1a0b-39fe-4322-8273-90b68313946c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:55.316722 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-35cd1a0b-39fe-4322-8273-90b68313946c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:55.319168 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-321d3320-7c6a-43fd-8389-b40b8a24e6c7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:55.327103 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-321d3320-7c6a-43fd-8389-b40b8a24e6c7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1240 microversion: 2.1 time: 0.067165 May 19 12:33:55.327865 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 522/1000] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:55 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:33:56.344934 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-58705f53-b9e3-4400-84c1-2b9bf18773db tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:56.345565 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-58705f53-b9e3-4400-84c1-2b9bf18773db tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:56.399416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-58705f53-b9e3-4400-84c1-2b9bf18773db tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:56.407024 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-58705f53-b9e3-4400-84c1-2b9bf18773db tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1240 microversion: 2.1 time: 0.065916 May 19 12:33:56.407533 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 523/1001] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:56 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:56.505289 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-35cd1a0b-39fe-4322-8273-90b68313946c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "POST /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.202456 May 19 12:33:56.511150 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 479/1002] 10.222.0.57 () {62 vars in 1363 bytes} [Thu May 19 12:33:55 2022] POST /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/os-volume_attachments => generated 188 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 12:33:56.623878 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-db9e5703-708c-4f2b-a093-128a2df6f737 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:56.624424 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-db9e5703-708c-4f2b-a093-128a2df6f737 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:56.630723 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-db9e5703-708c-4f2b-a093-128a2df6f737 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:56.631178 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-db9e5703-708c-4f2b-a093-128a2df6f737 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:56.631954 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-db9e5703-708c-4f2b-a093-128a2df6f737 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:56.632392 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-db9e5703-708c-4f2b-a093-128a2df6f737 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:57.316152 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-db9e5703-708c-4f2b-a093-128a2df6f737 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "DELETE /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/os-volume_attachments/dfa67be6-9ec5-4c66-bb40-d4a6b6abeb9d" status: 202 len: 0 microversion: 2.20 time: 0.696393 May 19 12:33:57.316761 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 524/1003] 10.222.0.57 () {60 vars in 1456 bytes} [Thu May 19 12:33:56 2022] DELETE /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/os-volume_attachments/dfa67be6-9ec5-4c66-bb40-d4a6b6abeb9d => generated 0 bytes in 698 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 12:33:57.374639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-15cc698c-7b81-40d4-b3b0-045fc9377926 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:33:57.375221 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-15cc698c-7b81-40d4-b3b0-045fc9377926 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:57.381927 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-15cc698c-7b81-40d4-b3b0-045fc9377926 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:57.382375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-15cc698c-7b81-40d4-b3b0-045fc9377926 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:57.383295 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-15cc698c-7b81-40d4-b3b0-045fc9377926 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:57.383733 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-15cc698c-7b81-40d4-b3b0-045fc9377926 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:57.424485 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ec85a5e4-5d44-403f-bc68-bfe7a57063a1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:57.425186 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ec85a5e4-5d44-403f-bc68-bfe7a57063a1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:57.431999 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec85a5e4-5d44-403f-bc68-bfe7a57063a1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:57.432552 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec85a5e4-5d44-403f-bc68-bfe7a57063a1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:57.433375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec85a5e4-5d44-403f-bc68-bfe7a57063a1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:57.433812 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec85a5e4-5d44-403f-bc68-bfe7a57063a1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:57.500663 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ec85a5e4-5d44-403f-bc68-bfe7a57063a1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:57.507516 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ec85a5e4-5d44-403f-bc68-bfe7a57063a1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1244 microversion: 2.1 time: 0.086928 May 19 12:33:57.508077 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 525/1004] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:57 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:33:57.594488 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-15cc698c-7b81-40d4-b3b0-045fc9377926 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "POST /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/action" status: 202 len: 0 microversion: 2.20 time: 0.224760 May 19 12:33:57.595747 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 480/1005] 10.222.0.57 () {62 vars in 1318 bytes} [Thu May 19 12:33:57 2022] POST /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 12:33:57.603309 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-38ea33d8-25f9-460e-8425-fec803163471 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:57.603925 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-38ea33d8-25f9-460e-8425-fec803163471 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:57.610920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-38ea33d8-25f9-460e-8425-fec803163471 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:57.611316 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-38ea33d8-25f9-460e-8425-fec803163471 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:57.612373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-38ea33d8-25f9-460e-8425-fec803163471 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:57.612816 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-38ea33d8-25f9-460e-8425-fec803163471 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:57.745990 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-38ea33d8-25f9-460e-8425-fec803163471 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:57.754222 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-38ea33d8-25f9-460e-8425-fec803163471 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:57.755761 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-38ea33d8-25f9-460e-8425-fec803163471 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:57.756918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-38ea33d8-25f9-460e-8425-fec803163471 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1672 microversion: 2.20 time: 0.157553 May 19 12:33:57.757478 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 526/1006] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:57 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:57.902315 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-43826442-3ee3-439e-9f65-241f31e0733f tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:57.904877 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-43826442-3ee3-439e-9f65-241f31e0733f tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:57.911594 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-43826442-3ee3-439e-9f65-241f31e0733f tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:57.912043 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-43826442-3ee3-439e-9f65-241f31e0733f tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:57.913529 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-43826442-3ee3-439e-9f65-241f31e0733f tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:57.914015 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-43826442-3ee3-439e-9f65-241f31e0733f tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:58.000141 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-43826442-3ee3-439e-9f65-241f31e0733f tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lazy-loading 'services' on Instance uuid 26aaef3d-8e42-46ab-92a8-3a9b1519b806 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:33:58.266424 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-43826442-3ee3-439e-9f65-241f31e0733f tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "DELETE /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806/os-volume_attachments/ff056158-f6df-4b38-808a-598fe65cda0c" status: 202 len: 0 microversion: 2.1 time: 0.368044 May 19 12:33:58.267071 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 481/1007] 10.222.0.57 () {58 vars in 1415 bytes} [Thu May 19 12:33:57 2022] DELETE /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806/os-volume_attachments/ff056158-f6df-4b38-808a-598fe65cda0c => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:33:58.525313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9ab812d7-a3c6-43f0-b6f6-0456602629ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:58.527141 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9ab812d7-a3c6-43f0-b6f6-0456602629ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:58.537116 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9ab812d7-a3c6-43f0-b6f6-0456602629ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:58.537992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9ab812d7-a3c6-43f0-b6f6-0456602629ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:58.538694 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9ab812d7-a3c6-43f0-b6f6-0456602629ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:58.539184 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9ab812d7-a3c6-43f0-b6f6-0456602629ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:58.610522 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9ab812d7-a3c6-43f0-b6f6-0456602629ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:58.618826 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9ab812d7-a3c6-43f0-b6f6-0456602629ae tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1236 microversion: 2.1 time: 0.098339 May 19 12:33:58.619413 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 527/1008] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:58 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1236 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:58.776901 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-76974ec9-8dea-4e10-85de-efc21921d4c9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:58.777639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-76974ec9-8dea-4e10-85de-efc21921d4c9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:58.784484 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-76974ec9-8dea-4e10-85de-efc21921d4c9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:58.784926 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-76974ec9-8dea-4e10-85de-efc21921d4c9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:58.785677 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-76974ec9-8dea-4e10-85de-efc21921d4c9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:58.786106 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-76974ec9-8dea-4e10-85de-efc21921d4c9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:58.924740 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-76974ec9-8dea-4e10-85de-efc21921d4c9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:58.933680 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-76974ec9-8dea-4e10-85de-efc21921d4c9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:58.936071 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-76974ec9-8dea-4e10-85de-efc21921d4c9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:58.937376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-76974ec9-8dea-4e10-85de-efc21921d4c9 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1672 microversion: 2.20 time: 0.165233 May 19 12:33:58.937941 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 482/1009] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:58 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:33:59.636161 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-13dc5380-d5c6-4b41-abd2-e47828da9208 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:59.636772 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-13dc5380-d5c6-4b41-abd2-e47828da9208 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:59.643734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-13dc5380-d5c6-4b41-abd2-e47828da9208 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:59.644182 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-13dc5380-d5c6-4b41-abd2-e47828da9208 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:59.644955 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-13dc5380-d5c6-4b41-abd2-e47828da9208 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:59.645391 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-13dc5380-d5c6-4b41-abd2-e47828da9208 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:59.708945 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-13dc5380-d5c6-4b41-abd2-e47828da9208 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:33:59.717569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-13dc5380-d5c6-4b41-abd2-e47828da9208 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1300 microversion: 2.1 time: 0.085284 May 19 12:33:59.718180 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 528/1010] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:33:59 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:33:59.956355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8706eee9-4429-437d-80c7-fb35618080d6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:33:59.957656 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8706eee9-4429-437d-80c7-fb35618080d6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:33:59.964217 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8706eee9-4429-437d-80c7-fb35618080d6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:59.964664 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8706eee9-4429-437d-80c7-fb35618080d6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:33:59.965983 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8706eee9-4429-437d-80c7-fb35618080d6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:33:59.966436 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8706eee9-4429-437d-80c7-fb35618080d6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:00.140612 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8706eee9-4429-437d-80c7-fb35618080d6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:00.148634 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8706eee9-4429-437d-80c7-fb35618080d6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:00.150202 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8706eee9-4429-437d-80c7-fb35618080d6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:00.151376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8706eee9-4429-437d-80c7-fb35618080d6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1674 microversion: 2.20 time: 0.199174 May 19 12:34:00.151930 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 483/1011] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:33:59 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:00.739627 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-11046e42-05cc-4212-b048-b934a1114416 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:00.740442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-11046e42-05cc-4212-b048-b934a1114416 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:00.749212 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-11046e42-05cc-4212-b048-b934a1114416 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:00.749665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-11046e42-05cc-4212-b048-b934a1114416 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:00.750481 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-11046e42-05cc-4212-b048-b934a1114416 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:00.751291 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-11046e42-05cc-4212-b048-b934a1114416 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:00.995847 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-11046e42-05cc-4212-b048-b934a1114416 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:01.004496 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-11046e42-05cc-4212-b048-b934a1114416 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.268800 May 19 12:34:01.005073 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 529/1012] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:00 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:01.173087 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b690cf2b-1e43-4577-880f-c0386dbb1792 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:01.173924 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b690cf2b-1e43-4577-880f-c0386dbb1792 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:01.182284 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b690cf2b-1e43-4577-880f-c0386dbb1792 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:01.182771 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b690cf2b-1e43-4577-880f-c0386dbb1792 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:01.183557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b690cf2b-1e43-4577-880f-c0386dbb1792 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:01.184057 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b690cf2b-1e43-4577-880f-c0386dbb1792 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:01.349927 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b690cf2b-1e43-4577-880f-c0386dbb1792 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:01.358993 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b690cf2b-1e43-4577-880f-c0386dbb1792 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:01.360609 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b690cf2b-1e43-4577-880f-c0386dbb1792 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:01.361726 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b690cf2b-1e43-4577-880f-c0386dbb1792 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.194696 May 19 12:34:01.362468 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 484/1013] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:01 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:01.731086 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-2feac8ac-359b-4395-9849-2ee950e2157c req-cc33054b-e594-43ca-a9e2-e5215bd53a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038dca0d-d260-4c40-a7a9-aca8ea121bf7", "tag": "543abcf6-9f44-4c9b-ae1f-bf82ebc9e926"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:01.739714 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-2feac8ac-359b-4395-9849-2ee950e2157c req-cc33054b-e594-43ca-a9e2-e5215bd53a02 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:01.740837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-2feac8ac-359b-4395-9849-2ee950e2157c req-cc33054b-e594-43ca-a9e2-e5215bd53a02 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:01.758671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-2feac8ac-359b-4395-9849-2ee950e2157c req-cc33054b-e594-43ca-a9e2-e5215bd53a02 service nova] Creating event network-changed:543abcf6-9f44-4c9b-ae1f-bf82ebc9e926 for instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 on hv-cinder-77819 May 19 12:34:01.765114 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-2feac8ac-359b-4395-9849-2ee950e2157c req-cc33054b-e594-43ca-a9e2-e5215bd53a02 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037825 May 19 12:34:01.765718 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 530/1014] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:01.825114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0260695a-bfe8-4d18-8b00-ac036a0b20aa tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:01.826135 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0260695a-bfe8-4d18-8b00-ac036a0b20aa tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:01.835404 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0260695a-bfe8-4d18-8b00-ac036a0b20aa tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:01.835940 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0260695a-bfe8-4d18-8b00-ac036a0b20aa tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:01.840895 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0260695a-bfe8-4d18-8b00-ac036a0b20aa tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:01.840895 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0260695a-bfe8-4d18-8b00-ac036a0b20aa tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:01.842624 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=7,nova_cell1:INSERT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:01.879754 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0260695a-bfe8-4d18-8b00-ac036a0b20aa tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058979 May 19 12:34:01.880555 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 485/1015] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:34:01 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:01.891722 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0fd578ff-4b26-4728-88c7-2d569dca0f58 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:01.892322 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0fd578ff-4b26-4728-88c7-2d569dca0f58 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:01.898820 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0fd578ff-4b26-4728-88c7-2d569dca0f58 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:01.899276 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0fd578ff-4b26-4728-88c7-2d569dca0f58 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:01.900077 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0fd578ff-4b26-4728-88c7-2d569dca0f58 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:01.900514 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0fd578ff-4b26-4728-88c7-2d569dca0f58 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:01.934223 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0fd578ff-4b26-4728-88c7-2d569dca0f58 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments/e7f062ec-b2b4-4543-bd8e-4619b9b00258" status: 200 len: 194 microversion: 2.1 time: 0.046989 May 19 12:34:01.939931 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 531/1016] 10.222.0.57 () {58 vars in 1412 bytes} [Thu May 19 12:34:01 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments/e7f062ec-b2b4-4543-bd8e-4619b9b00258 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:02.021656 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fb24b00d-687a-4b8c-b805-84f98d36cdb5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:02.022344 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fb24b00d-687a-4b8c-b805-84f98d36cdb5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:02.032150 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fb24b00d-687a-4b8c-b805-84f98d36cdb5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:02.032608 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fb24b00d-687a-4b8c-b805-84f98d36cdb5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:02.036010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fb24b00d-687a-4b8c-b805-84f98d36cdb5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:02.038363 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fb24b00d-687a-4b8c-b805-84f98d36cdb5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:02.248313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-fb24b00d-687a-4b8c-b805-84f98d36cdb5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:02.256811 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fb24b00d-687a-4b8c-b805-84f98d36cdb5 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.239438 May 19 12:34:02.257398 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 486/1017] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:02 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:02.382119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fd194e6b-7fd3-448d-9569-358429ca32dd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:02.382857 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fd194e6b-7fd3-448d-9569-358429ca32dd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:02.390046 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd194e6b-7fd3-448d-9569-358429ca32dd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:02.390520 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd194e6b-7fd3-448d-9569-358429ca32dd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:02.392015 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd194e6b-7fd3-448d-9569-358429ca32dd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:02.392501 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd194e6b-7fd3-448d-9569-358429ca32dd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:02.592702 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fd194e6b-7fd3-448d-9569-358429ca32dd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:02.604110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fd194e6b-7fd3-448d-9569-358429ca32dd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:02.607977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fd194e6b-7fd3-448d-9569-358429ca32dd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:02.610978 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fd194e6b-7fd3-448d-9569-358429ca32dd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.233238 May 19 12:34:02.623604 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 532/1018] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:02 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:02.633410 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e6e1b049-e9f7-461d-b459-427cd96dcdec tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:02.634664 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e6e1b049-e9f7-461d-b459-427cd96dcdec tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:02.644113 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6e1b049-e9f7-461d-b459-427cd96dcdec tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:02.644989 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6e1b049-e9f7-461d-b459-427cd96dcdec tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:02.646458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6e1b049-e9f7-461d-b459-427cd96dcdec tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:02.647326 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e6e1b049-e9f7-461d-b459-427cd96dcdec tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:02.680419 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e6e1b049-e9f7-461d-b459-427cd96dcdec tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:34:02.951394 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:02.971964 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:03.111985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e6e1b049-e9f7-461d-b459-427cd96dcdec tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "DELETE /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 204 len: 0 microversion: 2.1 time: 0.484248 May 19 12:34:03.112579 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 487/1019] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:34:02 2022] DELETE /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:34:03.120838 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-837ef299-d4d4-46b6-84a0-3b6cf420639a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:03.122255 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-837ef299-d4d4-46b6-84a0-3b6cf420639a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:03.129373 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-837ef299-d4d4-46b6-84a0-3b6cf420639a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:03.130082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-837ef299-d4d4-46b6-84a0-3b6cf420639a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:03.131091 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-837ef299-d4d4-46b6-84a0-3b6cf420639a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:03.131854 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-837ef299-d4d4-46b6-84a0-3b6cf420639a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:03.275053 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a1ec1bbe-4973-41bc-920d-99006a51d8ef tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:03.276429 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a1ec1bbe-4973-41bc-920d-99006a51d8ef tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:03.285250 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a1ec1bbe-4973-41bc-920d-99006a51d8ef tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:03.285482 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-837ef299-d4d4-46b6-84a0-3b6cf420639a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:03.286031 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a1ec1bbe-4973-41bc-920d-99006a51d8ef tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:03.286912 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a1ec1bbe-4973-41bc-920d-99006a51d8ef tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:03.287570 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a1ec1bbe-4973-41bc-920d-99006a51d8ef tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:03.294339 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-837ef299-d4d4-46b6-84a0-3b6cf420639a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.176425 May 19 12:34:03.295187 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 533/1020] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:03 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:03.435740 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a1ec1bbe-4973-41bc-920d-99006a51d8ef tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:03.443193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a1ec1bbe-4973-41bc-920d-99006a51d8ef tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.172800 May 19 12:34:03.443761 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 488/1021] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:03 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:03.642082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4e6c800f-6db2-48d9-a0c8-cb963cf9b963 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:03.643169 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4e6c800f-6db2-48d9-a0c8-cb963cf9b963 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:03.650211 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4e6c800f-6db2-48d9-a0c8-cb963cf9b963 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:03.650858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4e6c800f-6db2-48d9-a0c8-cb963cf9b963 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:03.651637 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4e6c800f-6db2-48d9-a0c8-cb963cf9b963 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:03.652071 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4e6c800f-6db2-48d9-a0c8-cb963cf9b963 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:03.802294 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4e6c800f-6db2-48d9-a0c8-cb963cf9b963 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:03.813091 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4e6c800f-6db2-48d9-a0c8-cb963cf9b963 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:03.814726 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4e6c800f-6db2-48d9-a0c8-cb963cf9b963 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:03.816015 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4e6c800f-6db2-48d9-a0c8-cb963cf9b963 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.178805 May 19 12:34:03.827012 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 534/1022] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:03 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:04.313849 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-390aa57c-13ba-46e8-9047-7d624328b557 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:04.314437 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-390aa57c-13ba-46e8-9047-7d624328b557 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:04.321152 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-390aa57c-13ba-46e8-9047-7d624328b557 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:04.321591 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-390aa57c-13ba-46e8-9047-7d624328b557 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:04.322380 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-390aa57c-13ba-46e8-9047-7d624328b557 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:04.322840 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-390aa57c-13ba-46e8-9047-7d624328b557 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:04.459818 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-544d5782-f760-4872-a394-9f995108cbfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:04.461217 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-544d5782-f760-4872-a394-9f995108cbfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:04.468460 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-544d5782-f760-4872-a394-9f995108cbfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:04.469062 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-544d5782-f760-4872-a394-9f995108cbfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:04.470056 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-544d5782-f760-4872-a394-9f995108cbfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:04.470846 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-544d5782-f760-4872-a394-9f995108cbfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:04.471317 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-390aa57c-13ba-46e8-9047-7d624328b557 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:04.475698 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:04.479506 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-390aa57c-13ba-46e8-9047-7d624328b557 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.169642 May 19 12:34:04.480177 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 489/1023] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:04 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:04.604959 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-544d5782-f760-4872-a394-9f995108cbfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:04.614055 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-544d5782-f760-4872-a394-9f995108cbfa tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.158222 May 19 12:34:04.614843 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 535/1024] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:04 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:04.803422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-900c5eaf-bd50-4372-aaad-334234e57786 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d057fad-ca0f-465c-8acb-35c4f57248a2"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:04.804506 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-900c5eaf-bd50-4372-aaad-334234e57786 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:04.811794 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-900c5eaf-bd50-4372-aaad-334234e57786 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:04.812253 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-900c5eaf-bd50-4372-aaad-334234e57786 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:04.812994 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-900c5eaf-bd50-4372-aaad-334234e57786 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:04.813424 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-900c5eaf-bd50-4372-aaad-334234e57786 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:04.835407 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a22b3574-f390-4d9c-8985-e7adc9458ac1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:04.841940 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a22b3574-f390-4d9c-8985-e7adc9458ac1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:04.848689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a22b3574-f390-4d9c-8985-e7adc9458ac1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:04.849211 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a22b3574-f390-4d9c-8985-e7adc9458ac1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:04.850166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a22b3574-f390-4d9c-8985-e7adc9458ac1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:04.850642 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a22b3574-f390-4d9c-8985-e7adc9458ac1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:05.020897 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a22b3574-f390-4d9c-8985-e7adc9458ac1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:05.031917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a22b3574-f390-4d9c-8985-e7adc9458ac1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:05.033871 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a22b3574-f390-4d9c-8985-e7adc9458ac1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:05.035515 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a22b3574-f390-4d9c-8985-e7adc9458ac1 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.204372 May 19 12:34:05.041953 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 536/1025] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:04 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:05.497645 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a5cf626b-1c74-45b8-b7f8-e8399e3779b2 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:05.498270 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a5cf626b-1c74-45b8-b7f8-e8399e3779b2 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:05.504730 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a5cf626b-1c74-45b8-b7f8-e8399e3779b2 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:05.505388 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a5cf626b-1c74-45b8-b7f8-e8399e3779b2 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:05.506161 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a5cf626b-1c74-45b8-b7f8-e8399e3779b2 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:05.506636 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a5cf626b-1c74-45b8-b7f8-e8399e3779b2 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:05.648175 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a5cf626b-1c74-45b8-b7f8-e8399e3779b2 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:05.658306 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a5cf626b-1c74-45b8-b7f8-e8399e3779b2 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.164746 May 19 12:34:05.664708 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 537/1026] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:05 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:05.667263 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f6b61785-9d05-4237-a802-e7c615ecb262 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:05.668220 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f6b61785-9d05-4237-a802-e7c615ecb262 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:05.675760 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f6b61785-9d05-4237-a802-e7c615ecb262 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:05.676622 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f6b61785-9d05-4237-a802-e7c615ecb262 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:05.677593 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f6b61785-9d05-4237-a802-e7c615ecb262 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:05.678246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f6b61785-9d05-4237-a802-e7c615ecb262 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:05.812758 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f6b61785-9d05-4237-a802-e7c615ecb262 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:05.820330 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f6b61785-9d05-4237-a802-e7c615ecb262 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.160030 May 19 12:34:05.820899 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 538/1027] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:05 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:06.055129 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c1a8b4bd-ae5f-46b4-9ff5-24c682f8a5c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:06.055740 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c1a8b4bd-ae5f-46b4-9ff5-24c682f8a5c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:06.063284 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c1a8b4bd-ae5f-46b4-9ff5-24c682f8a5c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:06.063731 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c1a8b4bd-ae5f-46b4-9ff5-24c682f8a5c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:06.064795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c1a8b4bd-ae5f-46b4-9ff5-24c682f8a5c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:06.065232 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c1a8b4bd-ae5f-46b4-9ff5-24c682f8a5c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:06.215887 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c1a8b4bd-ae5f-46b4-9ff5-24c682f8a5c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:06.224283 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c1a8b4bd-ae5f-46b4-9ff5-24c682f8a5c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:06.225798 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c1a8b4bd-ae5f-46b4-9ff5-24c682f8a5c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:06.227079 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c1a8b4bd-ae5f-46b4-9ff5-24c682f8a5c7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.176152 May 19 12:34:06.227873 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 539/1028] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:06 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:06.676648 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-864772c6-52e5-498e-8449-507f9e595205 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:06.677314 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-864772c6-52e5-498e-8449-507f9e595205 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:06.679139 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=12 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:06.684894 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-864772c6-52e5-498e-8449-507f9e595205 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:06.685355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-864772c6-52e5-498e-8449-507f9e595205 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:06.686173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-864772c6-52e5-498e-8449-507f9e595205 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:06.686615 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-864772c6-52e5-498e-8449-507f9e595205 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:06.825917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-864772c6-52e5-498e-8449-507f9e595205 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:06.833590 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-864772c6-52e5-498e-8449-507f9e595205 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.160827 May 19 12:34:06.836440 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 540/1029] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:06 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:06.838787 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ff7c528a-62c1-468e-9b7f-5481a475ea4c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:06.839596 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ff7c528a-62c1-468e-9b7f-5481a475ea4c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:06.845688 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ff7c528a-62c1-468e-9b7f-5481a475ea4c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:06.846141 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ff7c528a-62c1-468e-9b7f-5481a475ea4c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:06.846978 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ff7c528a-62c1-468e-9b7f-5481a475ea4c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:06.847422 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ff7c528a-62c1-468e-9b7f-5481a475ea4c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:07.001198 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ff7c528a-62c1-468e-9b7f-5481a475ea4c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:07.009476 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ff7c528a-62c1-468e-9b7f-5481a475ea4c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.174062 May 19 12:34:07.010463 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 541/1030] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:06 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:07.246237 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f572d635-9ccf-4a7e-bc0a-3783fdd11940 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:07.246793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f572d635-9ccf-4a7e-bc0a-3783fdd11940 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:07.253331 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f572d635-9ccf-4a7e-bc0a-3783fdd11940 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:07.253772 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f572d635-9ccf-4a7e-bc0a-3783fdd11940 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:07.254581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f572d635-9ccf-4a7e-bc0a-3783fdd11940 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:07.255019 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f572d635-9ccf-4a7e-bc0a-3783fdd11940 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:07.399349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f572d635-9ccf-4a7e-bc0a-3783fdd11940 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:07.407759 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f572d635-9ccf-4a7e-bc0a-3783fdd11940 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:07.409258 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f572d635-9ccf-4a7e-bc0a-3783fdd11940 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:07.410436 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f572d635-9ccf-4a7e-bc0a-3783fdd11940 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.168393 May 19 12:34:07.410998 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 542/1031] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:07 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:34:07.851566 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3cfcb8c0-ba27-4aa4-aad1-10b0e3f0eb17 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:07.852213 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3cfcb8c0-ba27-4aa4-aad1-10b0e3f0eb17 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:07.859331 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cfcb8c0-ba27-4aa4-aad1-10b0e3f0eb17 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:07.859778 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cfcb8c0-ba27-4aa4-aad1-10b0e3f0eb17 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:07.860559 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cfcb8c0-ba27-4aa4-aad1-10b0e3f0eb17 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:07.860999 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3cfcb8c0-ba27-4aa4-aad1-10b0e3f0eb17 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:08.006242 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3cfcb8c0-ba27-4aa4-aad1-10b0e3f0eb17 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:08.018462 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3cfcb8c0-ba27-4aa4-aad1-10b0e3f0eb17 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.170067 May 19 12:34:08.030992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 543/1032] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:07 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:08.037022 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6580570d-00ee-4855-ac08-275ba1653932 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:08.037635 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6580570d-00ee-4855-ac08-275ba1653932 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:08.039530 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:08.044393 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6580570d-00ee-4855-ac08-275ba1653932 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:08.045017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6580570d-00ee-4855-ac08-275ba1653932 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:08.045599 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6580570d-00ee-4855-ac08-275ba1653932 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:08.046039 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6580570d-00ee-4855-ac08-275ba1653932 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:08.197390 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6580570d-00ee-4855-ac08-275ba1653932 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:08.205546 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6580570d-00ee-4855-ac08-275ba1653932 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.172365 May 19 12:34:08.206127 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 544/1033] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:08 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:08.431150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2d2c2480-df78-4ded-9ac3-1457c443b263 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:08.431694 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2d2c2480-df78-4ded-9ac3-1457c443b263 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:08.440157 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2d2c2480-df78-4ded-9ac3-1457c443b263 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:08.440904 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2d2c2480-df78-4ded-9ac3-1457c443b263 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:08.441642 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2d2c2480-df78-4ded-9ac3-1457c443b263 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:08.442083 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2d2c2480-df78-4ded-9ac3-1457c443b263 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:08.577950 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2d2c2480-df78-4ded-9ac3-1457c443b263 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:08.586751 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2d2c2480-df78-4ded-9ac3-1457c443b263 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:08.588259 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2d2c2480-df78-4ded-9ac3-1457c443b263 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:08.589455 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2d2c2480-df78-4ded-9ac3-1457c443b263 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.164052 May 19 12:34:08.590038 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 545/1034] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:08 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:34:09.040387 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0ba10533-0648-49e0-b2ec-eec8d5c21680 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:09.041197 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0ba10533-0648-49e0-b2ec-eec8d5c21680 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:09.048957 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ba10533-0648-49e0-b2ec-eec8d5c21680 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:09.049404 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ba10533-0648-49e0-b2ec-eec8d5c21680 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:09.050209 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ba10533-0648-49e0-b2ec-eec8d5c21680 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:09.050674 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0ba10533-0648-49e0-b2ec-eec8d5c21680 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:09.202568 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0ba10533-0648-49e0-b2ec-eec8d5c21680 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:09.210280 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0ba10533-0648-49e0-b2ec-eec8d5c21680 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.174076 May 19 12:34:09.210881 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 546/1035] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:09 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:09.222893 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b113b980-371f-4161-a0da-5e258e3769be tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:09.223530 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b113b980-371f-4161-a0da-5e258e3769be tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:09.229543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b113b980-371f-4161-a0da-5e258e3769be tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:09.229985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b113b980-371f-4161-a0da-5e258e3769be tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:09.230773 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b113b980-371f-4161-a0da-5e258e3769be tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:09.231206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b113b980-371f-4161-a0da-5e258e3769be tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:09.381349 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b113b980-371f-4161-a0da-5e258e3769be tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:09.388981 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b113b980-371f-4161-a0da-5e258e3769be tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.169700 May 19 12:34:09.389562 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 547/1036] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:09 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:09.608796 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-89ca64ae-a4fc-44b5-bb0f-044a6271fb74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:09.609411 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-89ca64ae-a4fc-44b5-bb0f-044a6271fb74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:09.616095 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-89ca64ae-a4fc-44b5-bb0f-044a6271fb74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:09.616549 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-89ca64ae-a4fc-44b5-bb0f-044a6271fb74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:09.622884 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-89ca64ae-a4fc-44b5-bb0f-044a6271fb74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:09.622884 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-89ca64ae-a4fc-44b5-bb0f-044a6271fb74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:09.754832 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-89ca64ae-a4fc-44b5-bb0f-044a6271fb74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:09.767240 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-89ca64ae-a4fc-44b5-bb0f-044a6271fb74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:09.771765 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-89ca64ae-a4fc-44b5-bb0f-044a6271fb74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:09.771765 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-89ca64ae-a4fc-44b5-bb0f-044a6271fb74 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.166234 May 19 12:34:09.771765 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 548/1037] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:09 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:10.228628 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d76f78a1-32da-4ef0-9e20-432abb91c18e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:10.229393 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d76f78a1-32da-4ef0-9e20-432abb91c18e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:10.236732 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d76f78a1-32da-4ef0-9e20-432abb91c18e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:10.237191 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d76f78a1-32da-4ef0-9e20-432abb91c18e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:10.238465 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d76f78a1-32da-4ef0-9e20-432abb91c18e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:10.238949 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d76f78a1-32da-4ef0-9e20-432abb91c18e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:10.399534 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d76f78a1-32da-4ef0-9e20-432abb91c18e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:10.407957 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d76f78a1-32da-4ef0-9e20-432abb91c18e tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.183263 May 19 12:34:10.408538 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 549/1038] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:10 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:10.413132 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-98d1c490-0bed-4886-9064-1ff9d6cac21d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:10.413767 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-98d1c490-0bed-4886-9064-1ff9d6cac21d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:10.429128 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-98d1c490-0bed-4886-9064-1ff9d6cac21d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:10.429598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-98d1c490-0bed-4886-9064-1ff9d6cac21d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:10.430689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-98d1c490-0bed-4886-9064-1ff9d6cac21d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:10.431130 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-98d1c490-0bed-4886-9064-1ff9d6cac21d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:10.565102 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-98d1c490-0bed-4886-9064-1ff9d6cac21d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:10.572632 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-98d1c490-0bed-4886-9064-1ff9d6cac21d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.163125 May 19 12:34:10.573224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 550/1039] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:10 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:10.788247 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8cb3d3e5-96b1-4484-a32e-80794a8c4667 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:10.788855 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-8cb3d3e5-96b1-4484-a32e-80794a8c4667 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:10.795249 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8cb3d3e5-96b1-4484-a32e-80794a8c4667 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:10.796324 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8cb3d3e5-96b1-4484-a32e-80794a8c4667 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:10.797090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8cb3d3e5-96b1-4484-a32e-80794a8c4667 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:10.797522 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-8cb3d3e5-96b1-4484-a32e-80794a8c4667 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:10.948215 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8cb3d3e5-96b1-4484-a32e-80794a8c4667 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:10.950613 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:10.958534 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8cb3d3e5-96b1-4484-a32e-80794a8c4667 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:10.960294 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-8cb3d3e5-96b1-4484-a32e-80794a8c4667 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:10.961451 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8cb3d3e5-96b1-4484-a32e-80794a8c4667 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.177294 May 19 12:34:10.962215 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 551/1040] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:10 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:34:11.425715 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3e7a6446-decb-482b-a90b-0e8605216d05 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:11.426382 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3e7a6446-decb-482b-a90b-0e8605216d05 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:11.433222 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3e7a6446-decb-482b-a90b-0e8605216d05 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:11.433678 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3e7a6446-decb-482b-a90b-0e8605216d05 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:11.434482 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3e7a6446-decb-482b-a90b-0e8605216d05 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:11.434927 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3e7a6446-decb-482b-a90b-0e8605216d05 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:11.572763 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3e7a6446-decb-482b-a90b-0e8605216d05 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:11.580394 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3e7a6446-decb-482b-a90b-0e8605216d05 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.158918 May 19 12:34:11.580965 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 552/1041] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:11 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:11.590643 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d93c6cb2-dcfd-4b5e-8e67-40a92c30ee2e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:11.591250 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d93c6cb2-dcfd-4b5e-8e67-40a92c30ee2e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:11.598870 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d93c6cb2-dcfd-4b5e-8e67-40a92c30ee2e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:11.599321 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d93c6cb2-dcfd-4b5e-8e67-40a92c30ee2e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:11.600080 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d93c6cb2-dcfd-4b5e-8e67-40a92c30ee2e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:11.600516 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d93c6cb2-dcfd-4b5e-8e67-40a92c30ee2e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:11.748288 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d93c6cb2-dcfd-4b5e-8e67-40a92c30ee2e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:11.759604 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d93c6cb2-dcfd-4b5e-8e67-40a92c30ee2e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.172284 May 19 12:34:11.760909 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 553/1042] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:11 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:12.088650 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3fd997ca-744f-425c-b01a-9d634f07ced3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:12.088650 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3fd997ca-744f-425c-b01a-9d634f07ced3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:12.088650 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3fd997ca-744f-425c-b01a-9d634f07ced3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:12.088650 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3fd997ca-744f-425c-b01a-9d634f07ced3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:12.091250 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3fd997ca-744f-425c-b01a-9d634f07ced3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:12.091250 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3fd997ca-744f-425c-b01a-9d634f07ced3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:12.137720 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3fd997ca-744f-425c-b01a-9d634f07ced3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:12.147034 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3fd997ca-744f-425c-b01a-9d634f07ced3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:12.148630 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3fd997ca-744f-425c-b01a-9d634f07ced3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:12.150674 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3fd997ca-744f-425c-b01a-9d634f07ced3 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.174792 May 19 12:34:12.151767 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 554/1043] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:11 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:34:12.597523 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-abe594a2-6e09-4a5e-a220-18215af413de tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:12.598344 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-abe594a2-6e09-4a5e-a220-18215af413de tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:12.604678 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-abe594a2-6e09-4a5e-a220-18215af413de tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:12.605120 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-abe594a2-6e09-4a5e-a220-18215af413de tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:12.605907 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-abe594a2-6e09-4a5e-a220-18215af413de tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:12.606337 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-abe594a2-6e09-4a5e-a220-18215af413de tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:12.737363 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-abe594a2-6e09-4a5e-a220-18215af413de tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:12.744893 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-abe594a2-6e09-4a5e-a220-18215af413de tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.151385 May 19 12:34:12.745463 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 555/1044] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:12 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:12.777347 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c5761285-12e4-470b-9f65-7175e8031553 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:12.777953 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c5761285-12e4-470b-9f65-7175e8031553 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:12.784863 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c5761285-12e4-470b-9f65-7175e8031553 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:12.785261 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c5761285-12e4-470b-9f65-7175e8031553 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:12.786021 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c5761285-12e4-470b-9f65-7175e8031553 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:12.786485 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c5761285-12e4-470b-9f65-7175e8031553 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:12.924357 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c5761285-12e4-470b-9f65-7175e8031553 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:12.932315 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c5761285-12e4-470b-9f65-7175e8031553 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.159047 May 19 12:34:12.932879 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 556/1045] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:12 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:13.170068 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-91a30881-77ce-44cd-bba3-d6e6a2a98fd8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:13.170900 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-91a30881-77ce-44cd-bba3-d6e6a2a98fd8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:13.176916 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-91a30881-77ce-44cd-bba3-d6e6a2a98fd8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:13.177368 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-91a30881-77ce-44cd-bba3-d6e6a2a98fd8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:13.178130 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-91a30881-77ce-44cd-bba3-d6e6a2a98fd8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:13.178596 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-91a30881-77ce-44cd-bba3-d6e6a2a98fd8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:13.314490 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-91a30881-77ce-44cd-bba3-d6e6a2a98fd8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:13.322662 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-91a30881-77ce-44cd-bba3-d6e6a2a98fd8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:13.324299 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-91a30881-77ce-44cd-bba3-d6e6a2a98fd8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:13.325456 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-91a30881-77ce-44cd-bba3-d6e6a2a98fd8 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.159282 May 19 12:34:13.326008 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 557/1046] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:13 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:34:13.762653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c1d5b87d-e90b-45ce-ac66-b47554667467 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:13.763326 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c1d5b87d-e90b-45ce-ac66-b47554667467 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:13.771286 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c1d5b87d-e90b-45ce-ac66-b47554667467 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:13.771722 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c1d5b87d-e90b-45ce-ac66-b47554667467 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:13.772587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c1d5b87d-e90b-45ce-ac66-b47554667467 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:13.773080 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c1d5b87d-e90b-45ce-ac66-b47554667467 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:13.915652 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c1d5b87d-e90b-45ce-ac66-b47554667467 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:13.923195 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c1d5b87d-e90b-45ce-ac66-b47554667467 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.164466 May 19 12:34:13.923768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 558/1047] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:13 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:13.949922 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0c4d7256-2efb-4df2-a21a-65f480560cb1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:13.950591 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0c4d7256-2efb-4df2-a21a-65f480560cb1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:13.957366 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0c4d7256-2efb-4df2-a21a-65f480560cb1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:13.957813 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0c4d7256-2efb-4df2-a21a-65f480560cb1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:13.958703 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0c4d7256-2efb-4df2-a21a-65f480560cb1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:13.959143 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0c4d7256-2efb-4df2-a21a-65f480560cb1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:14.093867 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-0c4d7256-2efb-4df2-a21a-65f480560cb1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:14.101454 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0c4d7256-2efb-4df2-a21a-65f480560cb1 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.155178 May 19 12:34:14.102025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 559/1048] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:13 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:14.344463 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-85451139-f4a8-48ee-99f3-66519adfc41c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:14.344985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-85451139-f4a8-48ee-99f3-66519adfc41c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:14.351857 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-85451139-f4a8-48ee-99f3-66519adfc41c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:14.352303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-85451139-f4a8-48ee-99f3-66519adfc41c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:14.353079 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-85451139-f4a8-48ee-99f3-66519adfc41c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:14.353510 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-85451139-f4a8-48ee-99f3-66519adfc41c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:14.481206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-85451139-f4a8-48ee-99f3-66519adfc41c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:14.489712 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-85451139-f4a8-48ee-99f3-66519adfc41c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:14.491240 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-85451139-f4a8-48ee-99f3-66519adfc41c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:14.492432 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-85451139-f4a8-48ee-99f3-66519adfc41c tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.152098 May 19 12:34:14.492988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 560/1049] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:14 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:34:14.809041 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:14.897770 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:14.941468 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-55d9929d-0ddf-4dd3-98bc-d457d52de193 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:14.942298 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-55d9929d-0ddf-4dd3-98bc-d457d52de193 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:14.949253 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55d9929d-0ddf-4dd3-98bc-d457d52de193 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:14.949837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55d9929d-0ddf-4dd3-98bc-d457d52de193 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:14.950764 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55d9929d-0ddf-4dd3-98bc-d457d52de193 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:14.951372 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-55d9929d-0ddf-4dd3-98bc-d457d52de193 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:15.093206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-55d9929d-0ddf-4dd3-98bc-d457d52de193 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:15.100735 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-55d9929d-0ddf-4dd3-98bc-d457d52de193 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.164228 May 19 12:34:15.101306 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 561/1050] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:14 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:15.118376 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-81cd6a48-98bd-4591-afae-9eeb48be79a8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:15.119005 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-81cd6a48-98bd-4591-afae-9eeb48be79a8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:15.126133 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-81cd6a48-98bd-4591-afae-9eeb48be79a8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:15.126753 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-81cd6a48-98bd-4591-afae-9eeb48be79a8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:15.127517 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-81cd6a48-98bd-4591-afae-9eeb48be79a8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:15.127959 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-81cd6a48-98bd-4591-afae-9eeb48be79a8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:15.258109 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-81cd6a48-98bd-4591-afae-9eeb48be79a8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:15.267160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-81cd6a48-98bd-4591-afae-9eeb48be79a8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.152367 May 19 12:34:15.267885 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 562/1051] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:15 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:15.510957 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d986203e-1e42-4d84-b2d8-d656b2e7ff4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:15.511597 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d986203e-1e42-4d84-b2d8-d656b2e7ff4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:15.518378 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d986203e-1e42-4d84-b2d8-d656b2e7ff4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:15.518809 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d986203e-1e42-4d84-b2d8-d656b2e7ff4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:15.519578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d986203e-1e42-4d84-b2d8-d656b2e7ff4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:15.520020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d986203e-1e42-4d84-b2d8-d656b2e7ff4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:15.658005 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d986203e-1e42-4d84-b2d8-d656b2e7ff4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:15.666944 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d986203e-1e42-4d84-b2d8-d656b2e7ff4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:15.667721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d986203e-1e42-4d84-b2d8-d656b2e7ff4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:15.669065 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d986203e-1e42-4d84-b2d8-d656b2e7ff4d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.161871 May 19 12:34:15.669723 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 563/1052] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:15 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:34:16.117823 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4964cecc-7806-4135-bd9c-1287894bcdde tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:16.118514 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4964cecc-7806-4135-bd9c-1287894bcdde tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:16.126091 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4964cecc-7806-4135-bd9c-1287894bcdde tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:16.126571 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4964cecc-7806-4135-bd9c-1287894bcdde tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:16.127338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4964cecc-7806-4135-bd9c-1287894bcdde tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:16.127768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4964cecc-7806-4135-bd9c-1287894bcdde tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:16.262595 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4964cecc-7806-4135-bd9c-1287894bcdde tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:16.271148 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4964cecc-7806-4135-bd9c-1287894bcdde tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.157137 May 19 12:34:16.271712 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 564/1053] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:16 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:16.283945 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d6fdafd4-e276-400e-a550-b00ed3b41e85 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:16.284491 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d6fdafd4-e276-400e-a550-b00ed3b41e85 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:16.290653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d6fdafd4-e276-400e-a550-b00ed3b41e85 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:16.291111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d6fdafd4-e276-400e-a550-b00ed3b41e85 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:16.291883 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d6fdafd4-e276-400e-a550-b00ed3b41e85 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:16.292324 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d6fdafd4-e276-400e-a550-b00ed3b41e85 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:16.424081 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d6fdafd4-e276-400e-a550-b00ed3b41e85 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:16.431843 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d6fdafd4-e276-400e-a550-b00ed3b41e85 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.151601 May 19 12:34:16.432418 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 565/1054] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:16 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:16.688014 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4fddc97b-4c6f-4ec8-ac10-25de06618319 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:16.689190 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4fddc97b-4c6f-4ec8-ac10-25de06618319 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:16.695376 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4fddc97b-4c6f-4ec8-ac10-25de06618319 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:16.695819 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4fddc97b-4c6f-4ec8-ac10-25de06618319 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:16.696579 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4fddc97b-4c6f-4ec8-ac10-25de06618319 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:16.697012 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4fddc97b-4c6f-4ec8-ac10-25de06618319 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:16.824556 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4fddc97b-4c6f-4ec8-ac10-25de06618319 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:16.833002 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4fddc97b-4c6f-4ec8-ac10-25de06618319 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:16.834506 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4fddc97b-4c6f-4ec8-ac10-25de06618319 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:16.835661 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4fddc97b-4c6f-4ec8-ac10-25de06618319 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.151630 May 19 12:34:16.836220 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 566/1055] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:16 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:34:17.288401 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c2269ec2-b7c6-4e46-9a0c-aa4f55bd4b32 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:17.289065 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c2269ec2-b7c6-4e46-9a0c-aa4f55bd4b32 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:17.295629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c2269ec2-b7c6-4e46-9a0c-aa4f55bd4b32 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:17.297583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c2269ec2-b7c6-4e46-9a0c-aa4f55bd4b32 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:17.297583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c2269ec2-b7c6-4e46-9a0c-aa4f55bd4b32 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:17.297583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c2269ec2-b7c6-4e46-9a0c-aa4f55bd4b32 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:17.432442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c2269ec2-b7c6-4e46-9a0c-aa4f55bd4b32 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:17.440117 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c2269ec2-b7c6-4e46-9a0c-aa4f55bd4b32 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.155721 May 19 12:34:17.440691 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 567/1056] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:17 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:17.448579 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a16b349a-a724-4f3f-9abf-9ca142b907e8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:17.449187 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a16b349a-a724-4f3f-9abf-9ca142b907e8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:17.456102 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a16b349a-a724-4f3f-9abf-9ca142b907e8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:17.456568 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a16b349a-a724-4f3f-9abf-9ca142b907e8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:17.457361 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a16b349a-a724-4f3f-9abf-9ca142b907e8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:17.457799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a16b349a-a724-4f3f-9abf-9ca142b907e8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:17.473619 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:17.666217 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a16b349a-a724-4f3f-9abf-9ca142b907e8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:17.674331 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a16b349a-a724-4f3f-9abf-9ca142b907e8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.229261 May 19 12:34:17.675002 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 568/1057] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:17 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:17.858235 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3c2cb9d7-7aa4-4360-bce6-5ee28ee1a2e7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:17.858235 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3c2cb9d7-7aa4-4360-bce6-5ee28ee1a2e7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:17.864822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3c2cb9d7-7aa4-4360-bce6-5ee28ee1a2e7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:17.865270 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3c2cb9d7-7aa4-4360-bce6-5ee28ee1a2e7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:17.866130 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3c2cb9d7-7aa4-4360-bce6-5ee28ee1a2e7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:17.866693 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3c2cb9d7-7aa4-4360-bce6-5ee28ee1a2e7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:18.018541 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3c2cb9d7-7aa4-4360-bce6-5ee28ee1a2e7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:18.028997 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3c2cb9d7-7aa4-4360-bce6-5ee28ee1a2e7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:18.030849 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3c2cb9d7-7aa4-4360-bce6-5ee28ee1a2e7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:18.032377 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3c2cb9d7-7aa4-4360-bce6-5ee28ee1a2e7 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.179065 May 19 12:34:18.032864 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 569/1058] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:17 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:34:18.457975 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a0c48ced-4420-48c6-9528-678fe6b5e775 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:18.458809 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a0c48ced-4420-48c6-9528-678fe6b5e775 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:18.467716 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a0c48ced-4420-48c6-9528-678fe6b5e775 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:18.468336 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a0c48ced-4420-48c6-9528-678fe6b5e775 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:18.469368 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a0c48ced-4420-48c6-9528-678fe6b5e775 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:18.470060 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a0c48ced-4420-48c6-9528-678fe6b5e775 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:18.608934 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:34:18.608934 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Thu May 19 12:34:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 (ip 10.222.0.57) !!! May 19 12:34:18.768970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a0c48ced-4420-48c6-9528-678fe6b5e775 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:18.784601 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a0c48ced-4420-48c6-9528-678fe6b5e775 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1512 microversion: 2.1 time: 0.330749 May 19 12:34:18.785305 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 570/1059] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:18 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1512 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:18.792083 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-73b4fcb3-f78e-4447-9ecf-3c84176038b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:18.792870 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-73b4fcb3-f78e-4447-9ecf-3c84176038b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:18.800923 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-73b4fcb3-f78e-4447-9ecf-3c84176038b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:18.804361 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-73b4fcb3-f78e-4447-9ecf-3c84176038b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:18.804361 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-73b4fcb3-f78e-4447-9ecf-3c84176038b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:18.804361 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-73b4fcb3-f78e-4447-9ecf-3c84176038b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:18.936987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-73b4fcb3-f78e-4447-9ecf-3c84176038b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:18.944646 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-73b4fcb3-f78e-4447-9ecf-3c84176038b6 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.157222 May 19 12:34:18.945220 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 571/1060] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:18 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:19.050649 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-168195af-7934-4673-9337-7b61cb00f70b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:19.051363 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-168195af-7934-4673-9337-7b61cb00f70b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:19.057914 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-168195af-7934-4673-9337-7b61cb00f70b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:19.058473 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-168195af-7934-4673-9337-7b61cb00f70b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:19.059986 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-168195af-7934-4673-9337-7b61cb00f70b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:19.059986 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-168195af-7934-4673-9337-7b61cb00f70b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:19.213990 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-900c5eaf-bd50-4372-aaad-334234e57786 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "POST /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.414156 May 19 12:34:19.215313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 490/1061] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:34:04 2022] POST /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments => generated 194 bytes in 14417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:19.595529 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-168195af-7934-4673-9337-7b61cb00f70b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:19.603557 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-168195af-7934-4673-9337-7b61cb00f70b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:19.605344 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-168195af-7934-4673-9337-7b61cb00f70b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:19.606729 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-168195af-7934-4673-9337-7b61cb00f70b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.560082 May 19 12:34:19.607295 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 572/1062] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:19 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:34:19.802493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-15c23929-b1f2-46c3-965d-1ee48f9d591a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:19.803132 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-15c23929-b1f2-46c3-965d-1ee48f9d591a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:19.811906 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-15c23929-b1f2-46c3-965d-1ee48f9d591a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:19.812561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-15c23929-b1f2-46c3-965d-1ee48f9d591a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:19.813432 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-15c23929-b1f2-46c3-965d-1ee48f9d591a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:19.813876 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-15c23929-b1f2-46c3-965d-1ee48f9d591a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:19.871664 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-118f65b6-1ab0-45a4-827c-ba6f4cc1d250 req-c6f78194-8172-47ef-9107-a2952e91328e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26aaef3d-8e42-46ab-92a8-3a9b1519b806", "name": "network-vif-deleted", "tag": "8c94ddec-e1a4-46ea-80e4-6d16db77af3e"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:19.880087 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-15c23929-b1f2-46c3-965d-1ee48f9d591a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:19.880289 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-118f65b6-1ab0-45a4-827c-ba6f4cc1d250 req-c6f78194-8172-47ef-9107-a2952e91328e service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:19.880739 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-118f65b6-1ab0-45a4-827c-ba6f4cc1d250 req-c6f78194-8172-47ef-9107-a2952e91328e service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:19.892178 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-15c23929-b1f2-46c3-965d-1ee48f9d591a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1470 microversion: 2.1 time: 0.093331 May 19 12:34:19.895522 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-118f65b6-1ab0-45a4-827c-ba6f4cc1d250 req-c6f78194-8172-47ef-9107-a2952e91328e service nova] Creating event network-vif-deleted:8c94ddec-e1a4-46ea-80e4-6d16db77af3e for instance 26aaef3d-8e42-46ab-92a8-3a9b1519b806 on hv-cinder-77819 May 19 12:34:19.898774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 491/1063] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:19 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1470 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:19.907105 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-118f65b6-1ab0-45a4-827c-ba6f4cc1d250 req-c6f78194-8172-47ef-9107-a2952e91328e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039115 May 19 12:34:19.912812 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 573/1064] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:34:19.961031 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c5a48439-c4ee-4e2c-8cd0-bf4f58bd42ff tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:19.961649 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c5a48439-c4ee-4e2c-8cd0-bf4f58bd42ff tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:19.968366 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c5a48439-c4ee-4e2c-8cd0-bf4f58bd42ff tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:19.981651 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c5a48439-c4ee-4e2c-8cd0-bf4f58bd42ff tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:19.981651 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c5a48439-c4ee-4e2c-8cd0-bf4f58bd42ff tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:19.981651 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c5a48439-c4ee-4e2c-8cd0-bf4f58bd42ff tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:20.106704 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c5a48439-c4ee-4e2c-8cd0-bf4f58bd42ff tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:20.114879 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c5a48439-c4ee-4e2c-8cd0-bf4f58bd42ff tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.157650 May 19 12:34:20.115446 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 492/1065] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:19 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:20.626449 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-3602a4cd-dc3f-4704-87c2-d69848739305 req-a9ebb391-62b9-4425-9259-2544de0d4002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366b434a-af2f-4b06-beda-5bb9b4816e66", "name": "network-vif-plugged", "status": "completed", "tag": "aa50357b-95ff-4657-bbc2-3b5dd21e899e"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:20.627025 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7d81f61e-490a-4328-ace8-c7666a906b2b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:20.627400 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7d81f61e-490a-4328-ace8-c7666a906b2b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:20.633484 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7d81f61e-490a-4328-ace8-c7666a906b2b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:20.634054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7d81f61e-490a-4328-ace8-c7666a906b2b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:20.634902 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7d81f61e-490a-4328-ace8-c7666a906b2b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:20.635333 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7d81f61e-490a-4328-ace8-c7666a906b2b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:20.636065 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-3602a4cd-dc3f-4704-87c2-d69848739305 req-a9ebb391-62b9-4425-9259-2544de0d4002 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:20.636570 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-3602a4cd-dc3f-4704-87c2-d69848739305 req-a9ebb391-62b9-4425-9259-2544de0d4002 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:20.648657 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-3602a4cd-dc3f-4704-87c2-d69848739305 req-a9ebb391-62b9-4425-9259-2544de0d4002 service nova] Creating event network-vif-plugged:aa50357b-95ff-4657-bbc2-3b5dd21e899e for instance 366b434a-af2f-4b06-beda-5bb9b4816e66 on hv-cinder-77819 May 19 12:34:20.654288 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-3602a4cd-dc3f-4704-87c2-d69848739305 req-a9ebb391-62b9-4425-9259-2544de0d4002 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032822 May 19 12:34:20.655066 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 574/1066] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:20.772837 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7d81f61e-490a-4328-ace8-c7666a906b2b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:20.781297 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7d81f61e-490a-4328-ace8-c7666a906b2b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:20.783029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7d81f61e-490a-4328-ace8-c7666a906b2b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:20.784248 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7d81f61e-490a-4328-ace8-c7666a906b2b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.162833 May 19 12:34:20.784821 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 493/1067] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:20 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 12:34:20.913650 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-81506812-bf4f-4355-b379-d641f71c702a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:20.914343 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-81506812-bf4f-4355-b379-d641f71c702a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:20.921188 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-81506812-bf4f-4355-b379-d641f71c702a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:20.921626 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-81506812-bf4f-4355-b379-d641f71c702a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:20.922389 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-81506812-bf4f-4355-b379-d641f71c702a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:20.924335 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-81506812-bf4f-4355-b379-d641f71c702a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:20.985549 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-81506812-bf4f-4355-b379-d641f71c702a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:20.993328 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-81506812-bf4f-4355-b379-d641f71c702a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1470 microversion: 2.1 time: 0.083909 May 19 12:34:20.993914 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 575/1068] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:20 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1470 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:21.131957 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ba492147-8081-4132-abef-bd03b566657c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:21.132566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ba492147-8081-4132-abef-bd03b566657c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:21.139280 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba492147-8081-4132-abef-bd03b566657c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:21.139726 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba492147-8081-4132-abef-bd03b566657c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:21.140483 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba492147-8081-4132-abef-bd03b566657c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:21.141049 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ba492147-8081-4132-abef-bd03b566657c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:21.274849 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ba492147-8081-4132-abef-bd03b566657c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:21.283144 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ba492147-8081-4132-abef-bd03b566657c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.154948 May 19 12:34:21.283726 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 494/1069] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:21 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:21.802662 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9fc12291-a18a-4dea-b2d9-7c5836719428 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:21.807564 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9fc12291-a18a-4dea-b2d9-7c5836719428 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:21.810197 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9fc12291-a18a-4dea-b2d9-7c5836719428 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:21.810686 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9fc12291-a18a-4dea-b2d9-7c5836719428 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:21.811722 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9fc12291-a18a-4dea-b2d9-7c5836719428 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:21.812154 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9fc12291-a18a-4dea-b2d9-7c5836719428 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:21.939918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9fc12291-a18a-4dea-b2d9-7c5836719428 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:21.948026 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9fc12291-a18a-4dea-b2d9-7c5836719428 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:21.949524 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9fc12291-a18a-4dea-b2d9-7c5836719428 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:21.950721 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9fc12291-a18a-4dea-b2d9-7c5836719428 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.152298 May 19 12:34:21.951293 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 576/1070] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:21 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:22.011714 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4c8e587c-450e-423b-939c-4000d5cd8183 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:22.012323 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4c8e587c-450e-423b-939c-4000d5cd8183 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:22.019706 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4c8e587c-450e-423b-939c-4000d5cd8183 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:22.020150 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4c8e587c-450e-423b-939c-4000d5cd8183 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:22.020920 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4c8e587c-450e-423b-939c-4000d5cd8183 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:22.021356 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4c8e587c-450e-423b-939c-4000d5cd8183 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:22.098329 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4c8e587c-450e-423b-939c-4000d5cd8183 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:22.107907 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4c8e587c-450e-423b-939c-4000d5cd8183 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1470 microversion: 2.1 time: 0.099914 May 19 12:34:22.108491 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 495/1071] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:22 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1470 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:22.300166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a8cc0c58-964c-45d2-8c57-840c1ae2ed4e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:22.300768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a8cc0c58-964c-45d2-8c57-840c1ae2ed4e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:22.307840 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a8cc0c58-964c-45d2-8c57-840c1ae2ed4e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:22.308287 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a8cc0c58-964c-45d2-8c57-840c1ae2ed4e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:22.314147 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a8cc0c58-964c-45d2-8c57-840c1ae2ed4e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:22.314147 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a8cc0c58-964c-45d2-8c57-840c1ae2ed4e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:22.448862 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a8cc0c58-964c-45d2-8c57-840c1ae2ed4e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:22.463226 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a8cc0c58-964c-45d2-8c57-840c1ae2ed4e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.162826 May 19 12:34:22.463226 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 577/1072] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:22 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:22.969689 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4abe6a7d-d376-4158-b15c-ad225ee8327f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:22.970288 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4abe6a7d-d376-4158-b15c-ad225ee8327f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:22.977019 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4abe6a7d-d376-4158-b15c-ad225ee8327f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:22.977464 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4abe6a7d-d376-4158-b15c-ad225ee8327f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:22.978210 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4abe6a7d-d376-4158-b15c-ad225ee8327f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:22.978677 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4abe6a7d-d376-4158-b15c-ad225ee8327f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:23.111900 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4abe6a7d-d376-4158-b15c-ad225ee8327f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:23.120136 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4abe6a7d-d376-4158-b15c-ad225ee8327f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:23.121628 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4abe6a7d-d376-4158-b15c-ad225ee8327f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:23.122829 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4abe6a7d-d376-4158-b15c-ad225ee8327f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.157601 May 19 12:34:23.123402 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 496/1073] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:22 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:23.125034 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fa03886b-16f3-4ad0-aec8-e679ae62ccc0 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:23.125650 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fa03886b-16f3-4ad0-aec8-e679ae62ccc0 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:23.132421 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa03886b-16f3-4ad0-aec8-e679ae62ccc0 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:23.132872 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa03886b-16f3-4ad0-aec8-e679ae62ccc0 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:23.133659 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa03886b-16f3-4ad0-aec8-e679ae62ccc0 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:23.134108 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa03886b-16f3-4ad0-aec8-e679ae62ccc0 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:23.167188 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa03886b-16f3-4ad0-aec8-e679ae62ccc0 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:23.167632 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fa03886b-16f3-4ad0-aec8-e679ae62ccc0 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:23.168085 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-fa03886b-16f3-4ad0-aec8-e679ae62ccc0 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lazy-loading 'fault' on Instance uuid 26aaef3d-8e42-46ab-92a8-3a9b1519b806 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:34:23.210274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fa03886b-16f3-4ad0-aec8-e679ae62ccc0 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:23.218538 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fa03886b-16f3-4ad0-aec8-e679ae62ccc0 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 200 len: 1308 microversion: 2.1 time: 0.096996 May 19 12:34:23.219158 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 578/1074] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:23 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:23.476163 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e2fa863a-589b-4591-8f54-71614f05ec9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:23.476800 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e2fa863a-589b-4591-8f54-71614f05ec9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:23.482926 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e2fa863a-589b-4591-8f54-71614f05ec9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:23.483504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e2fa863a-589b-4591-8f54-71614f05ec9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:23.484362 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e2fa863a-589b-4591-8f54-71614f05ec9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:23.484879 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e2fa863a-589b-4591-8f54-71614f05ec9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:23.629806 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e2fa863a-589b-4591-8f54-71614f05ec9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:23.637651 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e2fa863a-589b-4591-8f54-71614f05ec9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.165297 May 19 12:34:23.638239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 497/1075] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:23 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:24.142149 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-29b0ec35-9c0c-4960-9e3d-f0fb35784d97 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:24.142784 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-29b0ec35-9c0c-4960-9e3d-f0fb35784d97 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:24.149229 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29b0ec35-9c0c-4960-9e3d-f0fb35784d97 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:24.149675 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29b0ec35-9c0c-4960-9e3d-f0fb35784d97 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:24.150454 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29b0ec35-9c0c-4960-9e3d-f0fb35784d97 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:24.150892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-29b0ec35-9c0c-4960-9e3d-f0fb35784d97 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:24.236468 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6f628536-ccb7-433f-9b16-c955a97be74d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:24.237051 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6f628536-ccb7-433f-9b16-c955a97be74d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 26aaef3d-8e42-46ab-92a8-3a9b1519b806] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:24.243734 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f628536-ccb7-433f-9b16-c955a97be74d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:24.244192 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f628536-ccb7-433f-9b16-c955a97be74d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:24.244954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f628536-ccb7-433f-9b16-c955a97be74d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:24.245400 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f628536-ccb7-433f-9b16-c955a97be74d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:24.259798 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-6f628536-ccb7-433f-9b16-c955a97be74d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] HTTP exception thrown: Instance 26aaef3d-8e42-46ab-92a8-3a9b1519b806 could not be found. May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6f628536-ccb7-433f-9b16-c955a97be74d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Request method failure captured: May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 HTTP/1.1 May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjjfXM5XWqJsbnz-wXZY1zTXfOIFS5mDyYtyjkypPayz-wr4S-aXYy7p3JRnBxkN6G1z__fdcZtqfoy1Ndb8CjSNj16CEhlKOQR7hY-9P50ND-rJdKb8ozUfW34qOOtS0wEIWQhB8gGYdh2f5oNZcYYjiX2leAWbEEzGrAGaF2SK7dY May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 886ee445e38e4c31bd4d4d014a7c4c7c May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1695631288 May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:34:24.261487 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:34:24.263301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/886ee445e38e4c31bd4d4d014a7c4c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/886ee445e38e4c31bd4d4d014a7c4c7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/886ee445e38e4c31bd4d4d014a7c4c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_886ee445e38e4c31bd4d4d014a7c4c7c", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:34:24.263301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesSnapshotTestJSON-1695631288 May 19 12:34:24.263301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 886ee445e38e4c31bd4d4d014a7c4c7c May 19 12:34:24.263301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1695631288 May 19 12:34:24.263301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesSnapshotTestJSON-1695631288-project May 19 12:34:24.263301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:34:24.263301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:34:24.263301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 8f609cfe0d7a4ded8a622c65d8690f7f May 19 12:34:24.263301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesSnapshotTestJSON-1695631288-project May 19 12:34:24.263301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:34:24.263301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance 26aaef3d-8e42-46ab-92a8-3a9b1519b806 could not be found. May 19 12:34:24.263301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '26aaef3d-8e42-46ab-92a8-3a9b1519b806'} May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26aaef3d-8e42-46ab-92a8-3a9b1519b806 could not be found. May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:34:24.264114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26aaef3d-8e42-46ab-92a8-3a9b1519b806 could not be found. May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26aaef3d-8e42-46ab-92a8-3a9b1519b806 could not be found. May 19 12:34:24.265557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:24.267751 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6f628536-ccb7-433f-9b16-c955a97be74d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Returning 404 to user: Instance 26aaef3d-8e42-46ab-92a8-3a9b1519b806 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:34:24.267751 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6f628536-ccb7-433f-9b16-c955a97be74d tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806" status: 404 len: 111 microversion: 2.1 time: 0.031072 May 19 12:34:24.267751 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 498/1076] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:24 2022] GET /compute/v2.1/servers/26aaef3d-8e42-46ab-92a8-3a9b1519b806 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:34:24.287805 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-29b0ec35-9c0c-4960-9e3d-f0fb35784d97 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:24.299981 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-29b0ec35-9c0c-4960-9e3d-f0fb35784d97 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:24.301484 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-29b0ec35-9c0c-4960-9e3d-f0fb35784d97 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:24.302711 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-29b0ec35-9c0c-4960-9e3d-f0fb35784d97 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.164543 May 19 12:34:24.303272 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 579/1077] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:24 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:24.654265 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d17fbcf3-60e6-4017-bd3f-84aa6871e236 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:24.655157 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d17fbcf3-60e6-4017-bd3f-84aa6871e236 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:24.663585 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d17fbcf3-60e6-4017-bd3f-84aa6871e236 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:24.664041 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d17fbcf3-60e6-4017-bd3f-84aa6871e236 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:24.664827 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d17fbcf3-60e6-4017-bd3f-84aa6871e236 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:24.665266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d17fbcf3-60e6-4017-bd3f-84aa6871e236 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:24.823937 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d17fbcf3-60e6-4017-bd3f-84aa6871e236 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:24.835068 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d17fbcf3-60e6-4017-bd3f-84aa6871e236 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.184390 May 19 12:34:24.835658 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 499/1078] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:24 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:25.321311 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e8bba3e1-8b4d-4858-aed9-69f15d53060a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:25.321874 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e8bba3e1-8b4d-4858-aed9-69f15d53060a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:25.329615 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e8bba3e1-8b4d-4858-aed9-69f15d53060a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:25.330061 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e8bba3e1-8b4d-4858-aed9-69f15d53060a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:25.330854 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e8bba3e1-8b4d-4858-aed9-69f15d53060a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:25.331287 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e8bba3e1-8b4d-4858-aed9-69f15d53060a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:25.470019 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e8bba3e1-8b4d-4858-aed9-69f15d53060a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:25.478463 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e8bba3e1-8b4d-4858-aed9-69f15d53060a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:25.479950 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e8bba3e1-8b4d-4858-aed9-69f15d53060a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:25.481100 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e8bba3e1-8b4d-4858-aed9-69f15d53060a tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.163809 May 19 12:34:25.481665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 580/1079] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:25 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:25.853039 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-de7cf901-9144-41e1-a63f-518c0f2a70ba tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:25.853791 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-de7cf901-9144-41e1-a63f-518c0f2a70ba tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:25.860923 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de7cf901-9144-41e1-a63f-518c0f2a70ba tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:25.861366 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de7cf901-9144-41e1-a63f-518c0f2a70ba tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:25.862130 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de7cf901-9144-41e1-a63f-518c0f2a70ba tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:25.862611 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-de7cf901-9144-41e1-a63f-518c0f2a70ba tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:25.991169 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-de7cf901-9144-41e1-a63f-518c0f2a70ba tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:25.999072 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-de7cf901-9144-41e1-a63f-518c0f2a70ba tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.149705 May 19 12:34:25.999671 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 500/1080] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:25 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:26.500598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-59950faa-bf62-4679-ae88-f97db4674a35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:26.501211 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-59950faa-bf62-4679-ae88-f97db4674a35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:26.507881 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-59950faa-bf62-4679-ae88-f97db4674a35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:26.508321 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-59950faa-bf62-4679-ae88-f97db4674a35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:26.509088 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-59950faa-bf62-4679-ae88-f97db4674a35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:26.509516 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-59950faa-bf62-4679-ae88-f97db4674a35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:26.648132 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-59950faa-bf62-4679-ae88-f97db4674a35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:26.659420 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-59950faa-bf62-4679-ae88-f97db4674a35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:26.659420 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-59950faa-bf62-4679-ae88-f97db4674a35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:26.659632 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-59950faa-bf62-4679-ae88-f97db4674a35 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.163717 May 19 12:34:26.663299 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 581/1081] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:26 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:27.016718 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1f385482-2395-4dea-afd2-073960e03ab9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:27.017338 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1f385482-2395-4dea-afd2-073960e03ab9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:27.023982 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f385482-2395-4dea-afd2-073960e03ab9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:27.024426 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f385482-2395-4dea-afd2-073960e03ab9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:27.025193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f385482-2395-4dea-afd2-073960e03ab9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:27.025620 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1f385482-2395-4dea-afd2-073960e03ab9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:27.157787 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1f385482-2395-4dea-afd2-073960e03ab9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:27.165425 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1f385482-2395-4dea-afd2-073960e03ab9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.153334 May 19 12:34:27.165986 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 501/1082] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:27 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:27.677174 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-65bd9ba1-3e29-46b4-81d8-d5c6a7d0d836 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:27.677694 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-65bd9ba1-3e29-46b4-81d8-d5c6a7d0d836 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:27.684648 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-65bd9ba1-3e29-46b4-81d8-d5c6a7d0d836 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:27.685094 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-65bd9ba1-3e29-46b4-81d8-d5c6a7d0d836 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:27.685862 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-65bd9ba1-3e29-46b4-81d8-d5c6a7d0d836 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:27.686549 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-65bd9ba1-3e29-46b4-81d8-d5c6a7d0d836 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:27.823020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-65bd9ba1-3e29-46b4-81d8-d5c6a7d0d836 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:27.831595 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-65bd9ba1-3e29-46b4-81d8-d5c6a7d0d836 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:27.833092 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-65bd9ba1-3e29-46b4-81d8-d5c6a7d0d836 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:27.834290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-65bd9ba1-3e29-46b4-81d8-d5c6a7d0d836 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.161102 May 19 12:34:27.834890 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 582/1083] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:27 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:28.183256 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-70bffa67-5d49-4188-b0d1-7e81739400d9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:28.183874 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-70bffa67-5d49-4188-b0d1-7e81739400d9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:28.191436 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-70bffa67-5d49-4188-b0d1-7e81739400d9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:28.191882 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-70bffa67-5d49-4188-b0d1-7e81739400d9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:28.192646 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-70bffa67-5d49-4188-b0d1-7e81739400d9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:28.193080 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-70bffa67-5d49-4188-b0d1-7e81739400d9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:28.325425 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-70bffa67-5d49-4188-b0d1-7e81739400d9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:28.333568 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-70bffa67-5d49-4188-b0d1-7e81739400d9 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.154415 May 19 12:34:28.334352 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 502/1084] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:28 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:28.853054 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-27e98467-3639-4255-8c8d-d91054f8f2da tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:28.853661 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-27e98467-3639-4255-8c8d-d91054f8f2da tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:28.860750 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-27e98467-3639-4255-8c8d-d91054f8f2da tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:28.861200 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-27e98467-3639-4255-8c8d-d91054f8f2da tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:28.861971 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-27e98467-3639-4255-8c8d-d91054f8f2da tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:28.862419 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-27e98467-3639-4255-8c8d-d91054f8f2da tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:28.995847 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-27e98467-3639-4255-8c8d-d91054f8f2da tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:29.004252 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-27e98467-3639-4255-8c8d-d91054f8f2da tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:29.005757 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-27e98467-3639-4255-8c8d-d91054f8f2da tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:29.006989 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-27e98467-3639-4255-8c8d-d91054f8f2da tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1730 microversion: 2.20 time: 0.157848 May 19 12:34:29.007549 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 583/1085] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:28 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:29.350773 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1041618f-8b5a-4b48-9828-836d5cea2080 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:29.351374 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1041618f-8b5a-4b48-9828-836d5cea2080 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:29.358059 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1041618f-8b5a-4b48-9828-836d5cea2080 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:29.358843 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1041618f-8b5a-4b48-9828-836d5cea2080 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:29.359624 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1041618f-8b5a-4b48-9828-836d5cea2080 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:29.360059 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1041618f-8b5a-4b48-9828-836d5cea2080 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:29.497629 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-1041618f-8b5a-4b48-9828-836d5cea2080 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:29.505152 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1041618f-8b5a-4b48-9828-836d5cea2080 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.158651 May 19 12:34:29.505728 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 503/1086] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:29 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:29.948912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-cbd9b355-b5d4-4164-9997-6e91d0402449 req-67bbe874-2ccc-4768-a72b-ccc60473d2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038dca0d-d260-4c40-a7a9-aca8ea121bf7", "name": "network-vif-plugged", "status": "completed", "tag": "543abcf6-9f44-4c9b-ae1f-bf82ebc9e926"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:29.957506 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-cbd9b355-b5d4-4164-9997-6e91d0402449 req-67bbe874-2ccc-4768-a72b-ccc60473d2ac service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:29.957942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-cbd9b355-b5d4-4164-9997-6e91d0402449 req-67bbe874-2ccc-4768-a72b-ccc60473d2ac service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:29.969012 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-cbd9b355-b5d4-4164-9997-6e91d0402449 req-67bbe874-2ccc-4768-a72b-ccc60473d2ac service nova] Creating event network-vif-plugged:543abcf6-9f44-4c9b-ae1f-bf82ebc9e926 for instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 on hv-cinder-77819 May 19 12:34:29.976961 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-cbd9b355-b5d4-4164-9997-6e91d0402449 req-67bbe874-2ccc-4768-a72b-ccc60473d2ac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028642 May 19 12:34:29.976961 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 584/1087] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:30.024954 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-46d1655e-bae0-44b3-b096-1ccc6b7b7c71 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:30.025213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-46d1655e-bae0-44b3-b096-1ccc6b7b7c71 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:30.032007 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46d1655e-bae0-44b3-b096-1ccc6b7b7c71 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:30.032519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46d1655e-bae0-44b3-b096-1ccc6b7b7c71 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:30.034334 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46d1655e-bae0-44b3-b096-1ccc6b7b7c71 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:30.034334 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46d1655e-bae0-44b3-b096-1ccc6b7b7c71 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:30.178481 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-46d1655e-bae0-44b3-b096-1ccc6b7b7c71 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:30.192171 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-46d1655e-bae0-44b3-b096-1ccc6b7b7c71 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:30.192171 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-46d1655e-bae0-44b3-b096-1ccc6b7b7c71 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:30.192171 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-46d1655e-bae0-44b3-b096-1ccc6b7b7c71 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1717 microversion: 2.20 time: 0.170522 May 19 12:34:30.192758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 504/1088] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:34:30 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1717 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:34:30.523877 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ebcc4651-6ac1-4361-91cd-3707c4478e87 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:30.524673 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ebcc4651-6ac1-4361-91cd-3707c4478e87 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:30.533532 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ebcc4651-6ac1-4361-91cd-3707c4478e87 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:30.534184 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ebcc4651-6ac1-4361-91cd-3707c4478e87 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:30.535356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ebcc4651-6ac1-4361-91cd-3707c4478e87 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:30.536054 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ebcc4651-6ac1-4361-91cd-3707c4478e87 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:30.679462 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ebcc4651-6ac1-4361-91cd-3707c4478e87 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:30.687480 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ebcc4651-6ac1-4361-91cd-3707c4478e87 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.168191 May 19 12:34:30.688048 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 585/1089] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:30 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:31.019880 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9f62f1d1-f0aa-4f79-aea1-75e80bc0c95d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:31.022061 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9f62f1d1-f0aa-4f79-aea1-75e80bc0c95d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:31.027842 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9f62f1d1-f0aa-4f79-aea1-75e80bc0c95d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:31.028303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9f62f1d1-f0aa-4f79-aea1-75e80bc0c95d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:31.029079 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9f62f1d1-f0aa-4f79-aea1-75e80bc0c95d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:31.029521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9f62f1d1-f0aa-4f79-aea1-75e80bc0c95d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:31.059430 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9f62f1d1-f0aa-4f79-aea1-75e80bc0c95d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043682 May 19 12:34:31.060029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 505/1090] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:34:31 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:31.199339 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0b6bcdc4-2c13-4eaa-bca3-5c301e7008a7 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:31.199941 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0b6bcdc4-2c13-4eaa-bca3-5c301e7008a7 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:31.207137 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0b6bcdc4-2c13-4eaa-bca3-5c301e7008a7 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:31.207593 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0b6bcdc4-2c13-4eaa-bca3-5c301e7008a7 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:31.208369 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0b6bcdc4-2c13-4eaa-bca3-5c301e7008a7 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:31.208809 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0b6bcdc4-2c13-4eaa-bca3-5c301e7008a7 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:31.236814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:31.240025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0b6bcdc4-2c13-4eaa-bca3-5c301e7008a7 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments/e7f062ec-b2b4-4543-bd8e-4619b9b00258" status: 200 len: 194 microversion: 2.1 time: 0.044640 May 19 12:34:31.245442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 586/1091] 10.222.0.57 () {58 vars in 1412 bytes} [Thu May 19 12:34:31 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments/e7f062ec-b2b4-4543-bd8e-4619b9b00258 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:31.251351 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-be1f1929-c6c6-425c-8f63-87ea9f14f75e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:31.251838 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-be1f1929-c6c6-425c-8f63-87ea9f14f75e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:31.257888 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be1f1929-c6c6-425c-8f63-87ea9f14f75e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:31.258341 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be1f1929-c6c6-425c-8f63-87ea9f14f75e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:31.259174 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be1f1929-c6c6-425c-8f63-87ea9f14f75e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:31.259864 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-be1f1929-c6c6-425c-8f63-87ea9f14f75e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:31.340708 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:31.344836 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-be1f1929-c6c6-425c-8f63-87ea9f14f75e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lazy-loading 'services' on Instance uuid f8876a3b-759b-45aa-afa1-c7b04fbc1c30 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:34:31.601652 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-be1f1929-c6c6-425c-8f63-87ea9f14f75e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments/e7f062ec-b2b4-4543-bd8e-4619b9b00258" status: 202 len: 0 microversion: 2.1 time: 0.354641 May 19 12:34:31.602244 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 506/1092] 10.222.0.57 () {58 vars in 1415 bytes} [Thu May 19 12:34:31 2022] DELETE /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments/e7f062ec-b2b4-4543-bd8e-4619b9b00258 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:34:31.703953 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ce825ffd-fba5-4eec-9a28-b22885ed2a77 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:31.704589 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ce825ffd-fba5-4eec-9a28-b22885ed2a77 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:31.711024 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ce825ffd-fba5-4eec-9a28-b22885ed2a77 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:31.711469 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ce825ffd-fba5-4eec-9a28-b22885ed2a77 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:31.712268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ce825ffd-fba5-4eec-9a28-b22885ed2a77 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:31.712700 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ce825ffd-fba5-4eec-9a28-b22885ed2a77 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:31.850342 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ce825ffd-fba5-4eec-9a28-b22885ed2a77 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:31.857726 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ce825ffd-fba5-4eec-9a28-b22885ed2a77 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.157770 May 19 12:34:31.859226 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 587/1093] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:31 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:32.875725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-14b1ee10-bf02-49f5-b3c9-b1d966d8a519 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:32.876421 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-14b1ee10-bf02-49f5-b3c9-b1d966d8a519 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:32.883305 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-14b1ee10-bf02-49f5-b3c9-b1d966d8a519 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:32.883753 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-14b1ee10-bf02-49f5-b3c9-b1d966d8a519 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:32.884515 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-14b1ee10-bf02-49f5-b3c9-b1d966d8a519 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:32.884948 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-14b1ee10-bf02-49f5-b3c9-b1d966d8a519 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:33.021633 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-14b1ee10-bf02-49f5-b3c9-b1d966d8a519 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:33.029376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-14b1ee10-bf02-49f5-b3c9-b1d966d8a519 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.158456 May 19 12:34:33.030648 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 507/1094] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:32 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:34.046211 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2b9dd627-cd71-4e2b-a913-428beeedebfb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:34.047697 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2b9dd627-cd71-4e2b-a913-428beeedebfb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:34.054323 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b9dd627-cd71-4e2b-a913-428beeedebfb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:34.054811 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b9dd627-cd71-4e2b-a913-428beeedebfb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:34.055837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b9dd627-cd71-4e2b-a913-428beeedebfb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:34.056277 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b9dd627-cd71-4e2b-a913-428beeedebfb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:34.184214 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2b9dd627-cd71-4e2b-a913-428beeedebfb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:34.191743 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2b9dd627-cd71-4e2b-a913-428beeedebfb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.149495 May 19 12:34:34.192543 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 588/1095] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:34 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:35.207935 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d674b0fa-abb0-4e90-88c7-afe331f8ff6b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:35.208557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d674b0fa-abb0-4e90-88c7-afe331f8ff6b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:35.215513 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d674b0fa-abb0-4e90-88c7-afe331f8ff6b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:35.215959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d674b0fa-abb0-4e90-88c7-afe331f8ff6b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:35.216716 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d674b0fa-abb0-4e90-88c7-afe331f8ff6b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:35.217146 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d674b0fa-abb0-4e90-88c7-afe331f8ff6b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:35.349834 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d674b0fa-abb0-4e90-88c7-afe331f8ff6b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:35.357611 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d674b0fa-abb0-4e90-88c7-afe331f8ff6b tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1366 microversion: 2.1 time: 0.153474 May 19 12:34:35.359310 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 508/1096] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:35 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:36.374567 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d960e1d8-7bad-4d77-9f8d-5314916c5b71 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:36.375278 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d960e1d8-7bad-4d77-9f8d-5314916c5b71 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:36.381703 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d960e1d8-7bad-4d77-9f8d-5314916c5b71 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:36.382153 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d960e1d8-7bad-4d77-9f8d-5314916c5b71 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:36.382953 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d960e1d8-7bad-4d77-9f8d-5314916c5b71 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:36.383390 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d960e1d8-7bad-4d77-9f8d-5314916c5b71 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:36.513718 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d960e1d8-7bad-4d77-9f8d-5314916c5b71 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:36.521654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d960e1d8-7bad-4d77-9f8d-5314916c5b71 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1556 microversion: 2.1 time: 0.150951 May 19 12:34:36.522218 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 589/1097] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:36 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:36.538273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6b306e6d-8cfe-4f87-aece-870f69c41a94 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:36.538815 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6b306e6d-8cfe-4f87-aece-870f69c41a94 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:36.545300 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6b306e6d-8cfe-4f87-aece-870f69c41a94 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:36.545741 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6b306e6d-8cfe-4f87-aece-870f69c41a94 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:36.546541 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6b306e6d-8cfe-4f87-aece-870f69c41a94 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:36.547861 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6b306e6d-8cfe-4f87-aece-870f69c41a94 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:36.626155 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6b306e6d-8cfe-4f87-aece-870f69c41a94 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091516 May 19 12:34:36.626740 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 509/1098] 10.222.0.57 () {58 vars in 1274 bytes} [Thu May 19 12:34:36 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:36.855165 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-867472420", "imageRef": "91cb3392-efa4-4637-aabf-70ad71fa4958", "flavorRef": "452", "networks": [{"uuid": "7c694785-3877-48e5-968a-02c3883c2332"}]}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:36.914300 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.network.neutron [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] validate_networks() for [('7c694785-3877-48e5-968a-02c3883c2332', None, None, None, None, None)] {{(pid=118112) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:34:37.519769 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Flavor limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:34:37.520361 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Image limits 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:34:37.520654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Flavor pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:34:37.521065 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Image pref 0:0:0 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:34:37.521480 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.virt.hardware [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118112) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:34:37.530513 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:37.530966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:37.532025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:37.532487 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:37.550968 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Getting quotas for project 886ee445e38e4c31bd4d4d014a7c4c7c. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:34:37.553215 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=100 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:37.556020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Getting quotas for user 8f609cfe0d7a4ded8a622c65d8690f7f and project 886ee445e38e4c31bd4d4d014a7c4c7c. Resources: {'ram', 'instances', 'cores'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:34:37.568944 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Going to run 1 instances... {{(pid=118112) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:34:37.571386 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='91cb3392-efa4-4637-aabf-70ad71fa4958',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118112) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:34:37.714119 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-0a3e56ed-a918-41bf-8aa8-c52b9699e1e8 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862613 May 19 12:34:37.714911 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 590/1099] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:34:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:34:37.726260 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-961a39f4-d88a-4325-8bc3-bacab9960cbd tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:37.727002 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-961a39f4-d88a-4325-8bc3-bacab9960cbd tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:37.811549 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-961a39f4-d88a-4325-8bc3-bacab9960cbd tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:37.819883 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-961a39f4-d88a-4325-8bc3-bacab9960cbd tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1218 microversion: 2.1 time: 0.098239 May 19 12:34:37.821104 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 510/1100] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:37 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:37.909676 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-71ba4e80-8727-4010-9e97-9426d4d526b7 req-245795d7-6d51-44f4-8800-385aeadf54b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "038dca0d-d260-4c40-a7a9-aca8ea121bf7", "tag": "543abcf6-9f44-4c9b-ae1f-bf82ebc9e926"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:37.917951 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-71ba4e80-8727-4010-9e97-9426d4d526b7 req-245795d7-6d51-44f4-8800-385aeadf54b9 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:37.918395 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-71ba4e80-8727-4010-9e97-9426d4d526b7 req-245795d7-6d51-44f4-8800-385aeadf54b9 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:37.931150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-71ba4e80-8727-4010-9e97-9426d4d526b7 req-245795d7-6d51-44f4-8800-385aeadf54b9 service nova] Creating event network-changed:543abcf6-9f44-4c9b-ae1f-bf82ebc9e926 for instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 on hv-cinder-77819 May 19 12:34:37.936924 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-71ba4e80-8727-4010-9e97-9426d4d526b7 req-245795d7-6d51-44f4-8800-385aeadf54b9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030945 May 19 12:34:37.937345 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 591/1101] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:38.018324 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0cd9605d-8e93-4444-8a58-6cdc04208ff9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:38.019327 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0cd9605d-8e93-4444-8a58-6cdc04208ff9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:38.029956 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0cd9605d-8e93-4444-8a58-6cdc04208ff9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:38.030512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0cd9605d-8e93-4444-8a58-6cdc04208ff9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:38.031919 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0cd9605d-8e93-4444-8a58-6cdc04208ff9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:38.032444 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0cd9605d-8e93-4444-8a58-6cdc04208ff9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:38.065611 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0cd9605d-8e93-4444-8a58-6cdc04208ff9 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments/2d057fad-ca0f-465c-8acb-35c4f57248a2" status: 200 len: 194 microversion: 2.1 time: 0.051937 May 19 12:34:38.066215 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 511/1102] 10.222.0.57 () {58 vars in 1412 bytes} [Thu May 19 12:34:38 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments/2d057fad-ca0f-465c-8acb-35c4f57248a2 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:38.076504 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6726680e-2704-48cd-b53c-2ede4794e48e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:38.077079 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6726680e-2704-48cd-b53c-2ede4794e48e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:38.083562 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6726680e-2704-48cd-b53c-2ede4794e48e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:38.084291 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6726680e-2704-48cd-b53c-2ede4794e48e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:38.085063 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6726680e-2704-48cd-b53c-2ede4794e48e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:38.085498 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6726680e-2704-48cd-b53c-2ede4794e48e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:38.175558 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-6726680e-2704-48cd-b53c-2ede4794e48e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lazy-loading 'services' on Instance uuid f8876a3b-759b-45aa-afa1-c7b04fbc1c30 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:34:38.430831 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6726680e-2704-48cd-b53c-2ede4794e48e tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments/2d057fad-ca0f-465c-8acb-35c4f57248a2" status: 202 len: 0 microversion: 2.1 time: 0.357895 May 19 12:34:38.431726 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 592/1103] 10.222.0.57 () {58 vars in 1415 bytes} [Thu May 19 12:34:38 2022] DELETE /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments/2d057fad-ca0f-465c-8acb-35c4f57248a2 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:34:38.837820 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-55711e1d-cd36-4a88-969a-5cf0b5b41a79 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:38.839098 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-55711e1d-cd36-4a88-969a-5cf0b5b41a79 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:38.845725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-55711e1d-cd36-4a88-969a-5cf0b5b41a79 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:38.846213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-55711e1d-cd36-4a88-969a-5cf0b5b41a79 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:38.847056 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-55711e1d-cd36-4a88-969a-5cf0b5b41a79 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:38.847493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-55711e1d-cd36-4a88-969a-5cf0b5b41a79 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:38.911797 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-55711e1d-cd36-4a88-969a-5cf0b5b41a79 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:38.920139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-55711e1d-cd36-4a88-969a-5cf0b5b41a79 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1222 microversion: 2.1 time: 0.086819 May 19 12:34:38.920727 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 512/1104] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:38 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:39.938958 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2ec216ee-faa8-434a-88b0-398eac4834b6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:39.939927 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2ec216ee-faa8-434a-88b0-398eac4834b6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:39.946243 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2ec216ee-faa8-434a-88b0-398eac4834b6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:39.946837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2ec216ee-faa8-434a-88b0-398eac4834b6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:39.947607 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2ec216ee-faa8-434a-88b0-398eac4834b6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:39.948045 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2ec216ee-faa8-434a-88b0-398eac4834b6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:40.032013 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2ec216ee-faa8-434a-88b0-398eac4834b6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:40.040823 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2ec216ee-faa8-434a-88b0-398eac4834b6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1270 microversion: 2.1 time: 0.106680 May 19 12:34:40.041408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 593/1105] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:39 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:40.660169 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6aad4359-a6e0-4081-a511-e1346fb8f784 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:40.661211 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6aad4359-a6e0-4081-a511-e1346fb8f784 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:40.669260 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6aad4359-a6e0-4081-a511-e1346fb8f784 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:40.670916 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6aad4359-a6e0-4081-a511-e1346fb8f784 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:40.672630 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6aad4359-a6e0-4081-a511-e1346fb8f784 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:40.673246 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6aad4359-a6e0-4081-a511-e1346fb8f784 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:40.704060 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6aad4359-a6e0-4081-a511-e1346fb8f784 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048398 May 19 12:34:40.704636 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 513/1106] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:34:40 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:34:40.820444 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-56c1dec5-8cf1-4225-9660-0a4c020a296d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:40.821475 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-56c1dec5-8cf1-4225-9660-0a4c020a296d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:40.827776 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-56c1dec5-8cf1-4225-9660-0a4c020a296d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:40.828284 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-56c1dec5-8cf1-4225-9660-0a4c020a296d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:40.829063 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-56c1dec5-8cf1-4225-9660-0a4c020a296d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:40.829569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-56c1dec5-8cf1-4225-9660-0a4c020a296d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:40.860514 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-56c1dec5-8cf1-4225-9660-0a4c020a296d tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043879 May 19 12:34:40.861075 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 594/1107] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:34:40 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:34:40.918399 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-217281f2-a2c9-4b4a-9518-02bc714b49de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:40.918919 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-217281f2-a2c9-4b4a-9518-02bc714b49de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:40.926302 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-217281f2-a2c9-4b4a-9518-02bc714b49de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:40.931928 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-217281f2-a2c9-4b4a-9518-02bc714b49de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:40.931928 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-217281f2-a2c9-4b4a-9518-02bc714b49de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:40.931928 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-217281f2-a2c9-4b4a-9518-02bc714b49de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:40.956426 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-217281f2-a2c9-4b4a-9518-02bc714b49de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:34:41.057419 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-af73fce6-d4d4-494a-81a0-078daccf5089 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:41.057934 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-af73fce6-d4d4-494a-81a0-078daccf5089 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:41.064665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-af73fce6-d4d4-494a-81a0-078daccf5089 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:41.065115 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-af73fce6-d4d4-494a-81a0-078daccf5089 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:41.065878 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-af73fce6-d4d4-494a-81a0-078daccf5089 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:41.066317 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-af73fce6-d4d4-494a-81a0-078daccf5089 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:41.199350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-af73fce6-d4d4-494a-81a0-078daccf5089 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:41.207739 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-af73fce6-d4d4-494a-81a0-078daccf5089 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1318 microversion: 2.1 time: 0.154396 May 19 12:34:41.208330 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 595/1108] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:41 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:41.310582 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-217281f2-a2c9-4b4a-9518-02bc714b49de tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 204 len: 0 microversion: 2.1 time: 0.395506 May 19 12:34:41.311033 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 514/1109] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:34:40 2022] DELETE /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:34:41.319640 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-159463e3-cc8d-4c1b-8999-113f7a9b064b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:41.320277 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-159463e3-cc8d-4c1b-8999-113f7a9b064b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:41.326506 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-159463e3-cc8d-4c1b-8999-113f7a9b064b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:41.326964 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-159463e3-cc8d-4c1b-8999-113f7a9b064b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:41.327728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-159463e3-cc8d-4c1b-8999-113f7a9b064b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:41.329111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-159463e3-cc8d-4c1b-8999-113f7a9b064b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:41.462858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-159463e3-cc8d-4c1b-8999-113f7a9b064b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:41.471544 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-159463e3-cc8d-4c1b-8999-113f7a9b064b tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1672 microversion: 2.1 time: 0.155806 May 19 12:34:41.472150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 596/1110] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:41 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:41.960933 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-a4e4c830-5548-4f2c-a5f3-1178e0c9d08d req-87af232f-abfb-4d92-aed0-21dd5650ca40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09fd2e57-5250-43c9-b8e6-4873e4caf351", "tag": "24c2206f-53eb-4f5e-aba8-c7f6b0ab6640"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:41.970394 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-a4e4c830-5548-4f2c-a5f3-1178e0c9d08d req-87af232f-abfb-4d92-aed0-21dd5650ca40 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:41.970953 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-a4e4c830-5548-4f2c-a5f3-1178e0c9d08d req-87af232f-abfb-4d92-aed0-21dd5650ca40 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:41.991135 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-a4e4c830-5548-4f2c-a5f3-1178e0c9d08d req-87af232f-abfb-4d92-aed0-21dd5650ca40 service nova] Creating event network-changed:24c2206f-53eb-4f5e-aba8-c7f6b0ab6640 for instance 09fd2e57-5250-43c9-b8e6-4873e4caf351 on hv-cinder-77819 May 19 12:34:41.996859 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-a4e4c830-5548-4f2c-a5f3-1178e0c9d08d req-87af232f-abfb-4d92-aed0-21dd5650ca40 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040342 May 19 12:34:41.997468 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 515/1111] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:42.224794 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-06609463-7ae0-4e29-8dbf-4fdcc5584666 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:42.225343 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-06609463-7ae0-4e29-8dbf-4fdcc5584666 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:42.231895 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-06609463-7ae0-4e29-8dbf-4fdcc5584666 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:42.232371 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-06609463-7ae0-4e29-8dbf-4fdcc5584666 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:42.233110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-06609463-7ae0-4e29-8dbf-4fdcc5584666 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:42.233544 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-06609463-7ae0-4e29-8dbf-4fdcc5584666 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:42.372016 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-06609463-7ae0-4e29-8dbf-4fdcc5584666 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:42.379774 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-06609463-7ae0-4e29-8dbf-4fdcc5584666 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1318 microversion: 2.1 time: 0.158934 May 19 12:34:42.380355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 597/1112] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:42 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:42.490440 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-77b94cc1-83b7-4298-9ed7-7f79f9c3ca63 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:42.491197 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-77b94cc1-83b7-4298-9ed7-7f79f9c3ca63 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:42.497416 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77b94cc1-83b7-4298-9ed7-7f79f9c3ca63 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:42.497868 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77b94cc1-83b7-4298-9ed7-7f79f9c3ca63 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:42.498672 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77b94cc1-83b7-4298-9ed7-7f79f9c3ca63 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:42.499100 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-77b94cc1-83b7-4298-9ed7-7f79f9c3ca63 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:42.635078 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-77b94cc1-83b7-4298-9ed7-7f79f9c3ca63 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:42.643136 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-77b94cc1-83b7-4298-9ed7-7f79f9c3ca63 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1672 microversion: 2.1 time: 0.157018 May 19 12:34:42.643697 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 516/1113] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:42 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:43.396872 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5a6f000d-3d86-4464-b63f-12a62d02c867 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:43.397605 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5a6f000d-3d86-4464-b63f-12a62d02c867 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:43.404795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5a6f000d-3d86-4464-b63f-12a62d02c867 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:43.405253 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5a6f000d-3d86-4464-b63f-12a62d02c867 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:43.406144 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5a6f000d-3d86-4464-b63f-12a62d02c867 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:43.406776 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5a6f000d-3d86-4464-b63f-12a62d02c867 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:43.588738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5a6f000d-3d86-4464-b63f-12a62d02c867 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:43.588738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5a6f000d-3d86-4464-b63f-12a62d02c867 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1318 microversion: 2.1 time: 0.189256 May 19 12:34:43.588738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 598/1114] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:43 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:43.661684 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-597daeab-35c0-469c-82e8-d351421b99bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:43.662239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-597daeab-35c0-469c-82e8-d351421b99bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:43.669386 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-597daeab-35c0-469c-82e8-d351421b99bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:43.669921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-597daeab-35c0-469c-82e8-d351421b99bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:43.670712 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-597daeab-35c0-469c-82e8-d351421b99bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:43.671171 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-597daeab-35c0-469c-82e8-d351421b99bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:43.810228 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-597daeab-35c0-469c-82e8-d351421b99bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:43.818778 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-597daeab-35c0-469c-82e8-d351421b99bb tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1672 microversion: 2.1 time: 0.160988 May 19 12:34:43.819348 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 517/1115] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:43 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:44.600225 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-51045286-e046-40b9-8925-20c73c1da31b tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:44.600940 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-51045286-e046-40b9-8925-20c73c1da31b tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:44.607792 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-51045286-e046-40b9-8925-20c73c1da31b tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:44.608246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-51045286-e046-40b9-8925-20c73c1da31b tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:44.609655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-51045286-e046-40b9-8925-20c73c1da31b tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:44.610118 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-51045286-e046-40b9-8925-20c73c1da31b tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:44.755289 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-51045286-e046-40b9-8925-20c73c1da31b tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:44.763008 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-51045286-e046-40b9-8925-20c73c1da31b tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1318 microversion: 2.1 time: 0.166662 May 19 12:34:44.763591 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 599/1116] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:44 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:44.837489 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cfebe7fb-db2a-4236-a5df-c017248d07d3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:44.838776 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cfebe7fb-db2a-4236-a5df-c017248d07d3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:44.846078 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cfebe7fb-db2a-4236-a5df-c017248d07d3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:44.846562 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cfebe7fb-db2a-4236-a5df-c017248d07d3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:44.847526 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cfebe7fb-db2a-4236-a5df-c017248d07d3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:44.847960 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cfebe7fb-db2a-4236-a5df-c017248d07d3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:44.928624 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cfebe7fb-db2a-4236-a5df-c017248d07d3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:44.936984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cfebe7fb-db2a-4236-a5df-c017248d07d3 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1605 microversion: 2.1 time: 0.103345 May 19 12:34:44.937571 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 518/1117] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:44 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1605 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:45.107599 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-d176b2e3-ca03-4dfb-8a73-89fb3d5c8819 req-f5e8031e-319a-4a3d-bc7c-0fde8ce3613f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8876a3b-759b-45aa-afa1-c7b04fbc1c30", "name": "network-vif-deleted", "tag": "547b537a-61af-4d9e-a3b4-3111d357ff91"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:45.116167 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-d176b2e3-ca03-4dfb-8a73-89fb3d5c8819 req-f5e8031e-319a-4a3d-bc7c-0fde8ce3613f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:45.116616 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-d176b2e3-ca03-4dfb-8a73-89fb3d5c8819 req-f5e8031e-319a-4a3d-bc7c-0fde8ce3613f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:45.128336 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-d176b2e3-ca03-4dfb-8a73-89fb3d5c8819 req-f5e8031e-319a-4a3d-bc7c-0fde8ce3613f service nova] Creating event network-vif-deleted:547b537a-61af-4d9e-a3b4-3111d357ff91 for instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 on hv-cinder-77819 May 19 12:34:45.133635 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-d176b2e3-ca03-4dfb-8a73-89fb3d5c8819 req-f5e8031e-319a-4a3d-bc7c-0fde8ce3613f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029626 May 19 12:34:45.134348 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 600/1118] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:45.780741 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a0013898-463b-45a3-b7ca-788ad19e4a91 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:45.781573 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a0013898-463b-45a3-b7ca-788ad19e4a91 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:45.783787 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:45.788837 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a0013898-463b-45a3-b7ca-788ad19e4a91 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:45.789295 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a0013898-463b-45a3-b7ca-788ad19e4a91 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:45.790069 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a0013898-463b-45a3-b7ca-788ad19e4a91 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:45.790544 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a0013898-463b-45a3-b7ca-788ad19e4a91 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:45.931694 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a0013898-463b-45a3-b7ca-788ad19e4a91 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:45.940490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a0013898-463b-45a3-b7ca-788ad19e4a91 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1318 microversion: 2.1 time: 0.163576 May 19 12:34:45.941058 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 519/1119] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:45 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:45.955377 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-27d98a7e-0359-41c5-a337-c96e57cba985 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:45.956077 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-27d98a7e-0359-41c5-a337-c96e57cba985 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:45.963015 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-27d98a7e-0359-41c5-a337-c96e57cba985 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:45.963388 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-27d98a7e-0359-41c5-a337-c96e57cba985 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:45.964173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-27d98a7e-0359-41c5-a337-c96e57cba985 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:45.964613 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-27d98a7e-0359-41c5-a337-c96e57cba985 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:46.032746 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-27d98a7e-0359-41c5-a337-c96e57cba985 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:46.040744 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-27d98a7e-0359-41c5-a337-c96e57cba985 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1605 microversion: 2.1 time: 0.090153 May 19 12:34:46.041339 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 601/1120] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:45 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1605 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:46.957679 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f34556fc-8b19-4471-8fdf-d779a4483fb1 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:46.958352 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f34556fc-8b19-4471-8fdf-d779a4483fb1 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:46.965146 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f34556fc-8b19-4471-8fdf-d779a4483fb1 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:46.968496 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f34556fc-8b19-4471-8fdf-d779a4483fb1 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:46.968496 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f34556fc-8b19-4471-8fdf-d779a4483fb1 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:46.968496 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f34556fc-8b19-4471-8fdf-d779a4483fb1 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:47.059755 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4bff2181-ff1a-4598-b495-d8dd73d9d5fd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:47.060475 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4bff2181-ff1a-4598-b495-d8dd73d9d5fd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:47.067654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4bff2181-ff1a-4598-b495-d8dd73d9d5fd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:47.068183 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4bff2181-ff1a-4598-b495-d8dd73d9d5fd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:47.069022 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4bff2181-ff1a-4598-b495-d8dd73d9d5fd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:47.069518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4bff2181-ff1a-4598-b495-d8dd73d9d5fd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:47.104774 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4bff2181-ff1a-4598-b495-d8dd73d9d5fd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:47.104774 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4bff2181-ff1a-4598-b495-d8dd73d9d5fd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:47.104774 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-4bff2181-ff1a-4598-b495-d8dd73d9d5fd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lazy-loading 'fault' on Instance uuid f8876a3b-759b-45aa-afa1-c7b04fbc1c30 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:34:47.105178 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f34556fc-8b19-4471-8fdf-d779a4483fb1 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:47.111291 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f34556fc-8b19-4471-8fdf-d779a4483fb1 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1318 microversion: 2.1 time: 0.158242 May 19 12:34:47.111876 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 520/1121] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:46 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:47.144639 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4bff2181-ff1a-4598-b495-d8dd73d9d5fd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '707a899d6c5d4c4ea1c58e0de6a85b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f4a6b5e282e45ffbef6963200558594', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:47.152230 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4bff2181-ff1a-4598-b495-d8dd73d9d5fd tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 200 len: 1327 microversion: 2.1 time: 0.096203 May 19 12:34:47.152802 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 602/1122] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:47 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:34:48.128119 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-92f4605b-185a-4a75-9c0a-36738b51ee15 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:48.128752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-92f4605b-185a-4a75-9c0a-36738b51ee15 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:48.130609 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:48.135916 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92f4605b-185a-4a75-9c0a-36738b51ee15 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:48.136376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92f4605b-185a-4a75-9c0a-36738b51ee15 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:48.137137 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92f4605b-185a-4a75-9c0a-36738b51ee15 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:48.137602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-92f4605b-185a-4a75-9c0a-36738b51ee15 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:48.171992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-549c3186-9c5f-4e83-92ff-b990208bbf27 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:48.173551 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-549c3186-9c5f-4e83-92ff-b990208bbf27 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:48.174703 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:48.175356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=6 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:48.181231 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-549c3186-9c5f-4e83-92ff-b990208bbf27 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:48.181737 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-549c3186-9c5f-4e83-92ff-b990208bbf27 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:48.182549 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-549c3186-9c5f-4e83-92ff-b990208bbf27 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:48.182981 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-549c3186-9c5f-4e83-92ff-b990208bbf27 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:48.196734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-549c3186-9c5f-4e83-92ff-b990208bbf27 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] HTTP exception thrown: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-549c3186-9c5f-4e83-92ff-b990208bbf27 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Request method failure captured: May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 HTTP/1.1 May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjbwSKiUFb7n4kp-B0wgMSyJehaE2r31sB0ovCPEa1ZhaHr058DFVt-yZusv6D-XcO8n44_WxnqFgpFiiJEPNyO7jrMuWvjCunkvXRIvGlpwVcxx8_l991qKHuXtJld0dpF9JLdPibUe0V-fXZ0b6Qx3OMEHcM3vYgr2NHsGNrSoR-8 May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 4f4a6b5e282e45ffbef6963200558594 May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:34:48.198381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:34:48.200051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f4a6b5e282e45ffbef6963200558594", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:34:48.200051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:48.200051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 4f4a6b5e282e45ffbef6963200558594 May 19 12:34:48.200051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:48.200051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeTestJSON-1862282835-project May 19 12:34:48.200051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:34:48.200051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:34:48.200051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 707a899d6c5d4c4ea1c58e0de6a85b1d May 19 12:34:48.200051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeTestJSON-1862282835-project May 19 12:34:48.200051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:34:48.200051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:48.200051 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': 'f8876a3b-759b-45aa-afa1-c7b04fbc1c30'} May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:34:48.200970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:48.203159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:48.204608 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-549c3186-9c5f-4e83-92ff-b990208bbf27 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Returning 404 to user: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:34:48.204608 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-549c3186-9c5f-4e83-92ff-b990208bbf27 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 404 len: 111 microversion: 2.1 time: 0.032137 May 19 12:34:48.204608 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 603/1123] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:48 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:34:48.209931 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4d1231d3-d783-4407-a2ac-e6b92b81c2f1 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '.version_select at 0x7fd4557e2820>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:48.276349 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-92f4605b-185a-4a75-9c0a-36738b51ee15 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:48.284735 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-92f4605b-185a-4a75-9c0a-36738b51ee15 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1318 microversion: 2.1 time: 0.160486 May 19 12:34:48.285315 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 521/1124] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:48 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:48.328465 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4d1231d3-d783-4407-a2ac-e6b92b81c2f1 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863777594" status: 202 len: 0 microversion: 2.1 time: 0.122218 May 19 12:34:48.329080 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 604/1125] 10.222.0.57 () {58 vars in 1220 bytes} [Thu May 19 12:34:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863777594 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:34:49.301066 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-723004e6-6190-48b6-a4ae-27a691c2cbca tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:49.301686 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-723004e6-6190-48b6-a4ae-27a691c2cbca tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:49.308579 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-723004e6-6190-48b6-a4ae-27a691c2cbca tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:49.309029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-723004e6-6190-48b6-a4ae-27a691c2cbca tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:49.309839 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-723004e6-6190-48b6-a4ae-27a691c2cbca tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:49.310273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-723004e6-6190-48b6-a4ae-27a691c2cbca tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:49.458125 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-723004e6-6190-48b6-a4ae-27a691c2cbca tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:49.465695 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-723004e6-6190-48b6-a4ae-27a691c2cbca tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1318 microversion: 2.1 time: 0.168452 May 19 12:34:49.468163 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 522/1126] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:49 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:49.963752 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-838beb45-f05a-4f2d-9c8a-e4260a95da4b req-383bb394-dc25-446b-b1ed-2a74f750889b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09fd2e57-5250-43c9-b8e6-4873e4caf351", "name": "network-vif-plugged", "status": "completed", "tag": "24c2206f-53eb-4f5e-aba8-c7f6b0ab6640"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:49.974615 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-838beb45-f05a-4f2d-9c8a-e4260a95da4b req-383bb394-dc25-446b-b1ed-2a74f750889b service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:49.974615 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-838beb45-f05a-4f2d-9c8a-e4260a95da4b req-383bb394-dc25-446b-b1ed-2a74f750889b service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:49.985830 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-838beb45-f05a-4f2d-9c8a-e4260a95da4b req-383bb394-dc25-446b-b1ed-2a74f750889b service nova] Creating event network-vif-plugged:24c2206f-53eb-4f5e-aba8-c7f6b0ab6640 for instance 09fd2e57-5250-43c9-b8e6-4873e4caf351 on hv-cinder-77819 May 19 12:34:49.990574 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-838beb45-f05a-4f2d-9c8a-e4260a95da4b req-383bb394-dc25-446b-b1ed-2a74f750889b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031899 May 19 12:34:49.991295 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 605/1127] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:34:50.482811 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-19b1126d-c990-4ca2-83e1-c951bbbf2ec6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:50.485327 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-19b1126d-c990-4ca2-83e1-c951bbbf2ec6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:50.490012 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-19b1126d-c990-4ca2-83e1-c951bbbf2ec6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:50.490491 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-19b1126d-c990-4ca2-83e1-c951bbbf2ec6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:50.491262 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-19b1126d-c990-4ca2-83e1-c951bbbf2ec6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:50.491698 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-19b1126d-c990-4ca2-83e1-c951bbbf2ec6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:50.496010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:50.630937 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-19b1126d-c990-4ca2-83e1-c951bbbf2ec6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:50.638270 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-19b1126d-c990-4ca2-83e1-c951bbbf2ec6 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1318 microversion: 2.1 time: 0.159281 May 19 12:34:50.638902 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 523/1128] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:50 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:51.657564 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5319ddb5-8721-4190-a5a7-3e5f9e956e14 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:51.658174 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5319ddb5-8721-4190-a5a7-3e5f9e956e14 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:51.664544 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5319ddb5-8721-4190-a5a7-3e5f9e956e14 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:51.664985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5319ddb5-8721-4190-a5a7-3e5f9e956e14 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:51.665741 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5319ddb5-8721-4190-a5a7-3e5f9e956e14 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:51.666167 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5319ddb5-8721-4190-a5a7-3e5f9e956e14 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:51.757865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d4c0aa9b-10a3-476b-8595-e12f27cedf36 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:51.758983 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d4c0aa9b-10a3-476b-8595-e12f27cedf36 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:51.766807 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d4c0aa9b-10a3-476b-8595-e12f27cedf36 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:51.767254 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d4c0aa9b-10a3-476b-8595-e12f27cedf36 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:51.768053 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d4c0aa9b-10a3-476b-8595-e12f27cedf36 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:51.768481 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d4c0aa9b-10a3-476b-8595-e12f27cedf36 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:51.783361 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-d4c0aa9b-10a3-476b-8595-e12f27cedf36 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] HTTP exception thrown: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d4c0aa9b-10a3-476b-8595-e12f27cedf36 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Request method failure captured: May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 HTTP/1.1 May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjbwSKiUFb7n4kp-B0wgMSyJehaE2r31sB0ovCPEa1ZhaHr058DFVt-yZusv6D-XcO8n44_WxnqFgpFiiJEPNyO7jrMuWvjCunkvXRIvGlpwVcxx8_l991qKHuXtJld0dpF9JLdPibUe0V-fXZ0b6Qx3OMEHcM3vYgr2NHsGNrSoR-8 May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 4f4a6b5e282e45ffbef6963200558594 May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:34:51.785024 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:34:51.787185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f4a6b5e282e45ffbef6963200558594", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:34:51.787185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:51.787185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 4f4a6b5e282e45ffbef6963200558594 May 19 12:34:51.787185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:51.787185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeTestJSON-1862282835-project May 19 12:34:51.787185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:34:51.787185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:34:51.787185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 707a899d6c5d4c4ea1c58e0de6a85b1d May 19 12:34:51.787185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeTestJSON-1862282835-project May 19 12:34:51.787185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:34:51.787185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:51.787185 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': 'f8876a3b-759b-45aa-afa1-c7b04fbc1c30'} May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:34:51.788463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:51.790067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:51.791647 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d4c0aa9b-10a3-476b-8595-e12f27cedf36 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Returning 404 to user: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:34:51.791647 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d4c0aa9b-10a3-476b-8595-e12f27cedf36 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 404 len: 111 microversion: 2.1 time: 0.033274 May 19 12:34:51.791647 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 524/1129] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:34:51 2022] DELETE /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:34:51.794718 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f03b4cf1-f71a-4f14-a141-99ef69a56644 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:51.795323 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f03b4cf1-f71a-4f14-a141-99ef69a56644 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: f8876a3b-759b-45aa-afa1-c7b04fbc1c30] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:51.801670 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f03b4cf1-f71a-4f14-a141-99ef69a56644 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:51.802114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f03b4cf1-f71a-4f14-a141-99ef69a56644 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:51.802916 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f03b4cf1-f71a-4f14-a141-99ef69a56644 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:51.803341 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f03b4cf1-f71a-4f14-a141-99ef69a56644 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:51.806656 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5319ddb5-8721-4190-a5a7-3e5f9e956e14 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:51.809085 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:34:51.815452 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5319ddb5-8721-4190-a5a7-3e5f9e956e14 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1318 microversion: 2.1 time: 0.163779 May 19 12:34:51.816078 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 606/1130] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:51 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:51.818097 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-f03b4cf1-f71a-4f14-a141-99ef69a56644 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] HTTP exception thrown: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f03b4cf1-f71a-4f14-a141-99ef69a56644 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Request method failure captured: May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 HTTP/1.1 May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjbwSKiUFb7n4kp-B0wgMSyJehaE2r31sB0ovCPEa1ZhaHr058DFVt-yZusv6D-XcO8n44_WxnqFgpFiiJEPNyO7jrMuWvjCunkvXRIvGlpwVcxx8_l991qKHuXtJld0dpF9JLdPibUe0V-fXZ0b6Qx3OMEHcM3vYgr2NHsGNrSoR-8 May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 4f4a6b5e282e45ffbef6963200558594 May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:34:51.819696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:34:51.821240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f4a6b5e282e45ffbef6963200558594", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:34:51.821240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:51.821240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 4f4a6b5e282e45ffbef6963200558594 May 19 12:34:51.821240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:51.821240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeTestJSON-1862282835-project May 19 12:34:51.821240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:34:51.821240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:34:51.821240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 707a899d6c5d4c4ea1c58e0de6a85b1d May 19 12:34:51.821240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeTestJSON-1862282835-project May 19 12:34:51.821240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:34:51.821240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:51.821240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': 'f8876a3b-759b-45aa-afa1-c7b04fbc1c30'} May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:34:51.822121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. May 19 12:34:51.823460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:34:51.824509 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f03b4cf1-f71a-4f14-a141-99ef69a56644 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Returning 404 to user: Instance f8876a3b-759b-45aa-afa1-c7b04fbc1c30 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:34:51.824509 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f03b4cf1-f71a-4f14-a141-99ef69a56644 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30" status: 404 len: 111 microversion: 2.1 time: 0.030114 May 19 12:34:51.824509 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 525/1131] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:51 2022] GET /compute/v2.1/servers/f8876a3b-759b-45aa-afa1-c7b04fbc1c30 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:34:52.832921 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b37af208-2782-497a-8376-e49605f0a1b9 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:52.833542 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b37af208-2782-497a-8376-e49605f0a1b9 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:52.841404 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b37af208-2782-497a-8376-e49605f0a1b9 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:52.841908 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b37af208-2782-497a-8376-e49605f0a1b9 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:52.842929 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b37af208-2782-497a-8376-e49605f0a1b9 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:52.843682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b37af208-2782-497a-8376-e49605f0a1b9 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:52.974544 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b37af208-2782-497a-8376-e49605f0a1b9 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:34:52.982060 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b37af208-2782-497a-8376-e49605f0a1b9 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1506 microversion: 2.1 time: 0.152999 May 19 12:34:52.982579 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 607/1132] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:52 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:34:52.999206 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-344c296d-f614-4854-ad70-7b078c37f362 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57b7966f-66ad-420a-b226-6beb6de8e849", "device": "/dev/sdb"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:34:53.001267 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-344c296d-f614-4854-ad70-7b078c37f362 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:53.007702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-344c296d-f614-4854-ad70-7b078c37f362 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:53.008144 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-344c296d-f614-4854-ad70-7b078c37f362 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:53.008910 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-344c296d-f614-4854-ad70-7b078c37f362 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:53.009341 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-344c296d-f614-4854-ad70-7b078c37f362 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:53.156953 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1d5b4925-7542-4ea0-ba33-6192464678d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:53.157453 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-1d5b4925-7542-4ea0-ba33-6192464678d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:53.163557 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1d5b4925-7542-4ea0-ba33-6192464678d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:53.167172 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1d5b4925-7542-4ea0-ba33-6192464678d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:53.167172 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1d5b4925-7542-4ea0-ba33-6192464678d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:53.167172 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-1d5b4925-7542-4ea0-ba33-6192464678d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:53.178618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-1d5b4925-7542-4ea0-ba33-6192464678d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] HTTP exception thrown: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1d5b4925-7542-4ea0-ba33-6192464678d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Request method failure captured: May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: DELETE /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 HTTP/1.1 May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjbwSKiUFb7n4kp-B0wgMSyJehaE2r31sB0ovCPEa1ZhaHr058DFVt-yZusv6D-XcO8n44_WxnqFgpFiiJEPNyO7jrMuWvjCunkvXRIvGlpwVcxx8_l991qKHuXtJld0dpF9JLdPibUe0V-fXZ0b6Qx3OMEHcM3vYgr2NHsGNrSoR-8 May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 4f4a6b5e282e45ffbef6963200558594 May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:34:53.180547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:34:53.182017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f4a6b5e282e45ffbef6963200558594", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:34:53.182017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:53.182017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 4f4a6b5e282e45ffbef6963200558594 May 19 12:34:53.182017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:53.182017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeTestJSON-1862282835-project May 19 12:34:53.182017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:34:53.182017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:34:53.182017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 707a899d6c5d4c4ea1c58e0de6a85b1d May 19 12:34:53.182017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeTestJSON-1862282835-project May 19 12:34:53.182017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:34:53.182017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:34:53.182017 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': 'c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1'} May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:34:53.182785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:34:53.184173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:53.185600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-1d5b4925-7542-4ea0-ba33-6192464678d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Returning 404 to user: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:34:53.185600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-1d5b4925-7542-4ea0-ba33-6192464678d8 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 404 len: 111 microversion: 2.1 time: 0.029663 May 19 12:34:53.185600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 608/1133] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:34:53 2022] DELETE /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:34:53.191725 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b820fcfa-0548-4e5a-9398-295d74a67403 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:34:53.192770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b820fcfa-0548-4e5a-9398-295d74a67403 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] [instance: c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:34:53.200049 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b820fcfa-0548-4e5a-9398-295d74a67403 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:53.200580 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b820fcfa-0548-4e5a-9398-295d74a67403 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:53.201499 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b820fcfa-0548-4e5a-9398-295d74a67403 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:34:53.202007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b820fcfa-0548-4e5a-9398-295d74a67403 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:34:53.217079 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-b820fcfa-0548-4e5a-9398-295d74a67403 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] HTTP exception thrown: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b820fcfa-0548-4e5a-9398-295d74a67403 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Request method failure captured: May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 HTTP/1.1 May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjbwSKiUFb7n4kp-B0wgMSyJehaE2r31sB0ovCPEa1ZhaHr058DFVt-yZusv6D-XcO8n44_WxnqFgpFiiJEPNyO7jrMuWvjCunkvXRIvGlpwVcxx8_l991qKHuXtJld0dpF9JLdPibUe0V-fXZ0b6Qx3OMEHcM3vYgr2NHsGNrSoR-8 May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 4f4a6b5e282e45ffbef6963200558594 May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:34:53.223246 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:34:53.224770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/4f4a6b5e282e45ffbef6963200558594"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_4f4a6b5e282e45ffbef6963200558594", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:34:53.224770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:53.224770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 4f4a6b5e282e45ffbef6963200558594 May 19 12:34:53.224770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1862282835 May 19 12:34:53.224770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeTestJSON-1862282835-project May 19 12:34:53.224770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:34:53.224770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:34:53.224770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 707a899d6c5d4c4ea1c58e0de6a85b1d May 19 12:34:53.224770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeTestJSON-1862282835-project May 19 12:34:53.224770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:34:53.224770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:34:53.224770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': 'c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1'} May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:34:53.225655 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. May 19 12:34:53.227618 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:34:53.228875 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b820fcfa-0548-4e5a-9398-295d74a67403 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] Returning 404 to user: Instance c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:34:53.228875 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b820fcfa-0548-4e5a-9398-295d74a67403 tempest-AttachVolumeTestJSON-1862282835 tempest-AttachVolumeTestJSON-1862282835-project] 10.222.0.57 "GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1" status: 404 len: 111 microversion: 2.1 time: 0.034235 May 19 12:34:53.228875 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 609/1134] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:34:53 2022] GET /compute/v2.1/servers/c07a544b-7df5-42cd-9ee3-fb5cbcea4cf1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:34:53.817198 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-344c296d-f614-4854-ad70-7b078c37f362 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "POST /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821585 May 19 12:34:53.817852 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 526/1135] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:34:52 2022] POST /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351/os-volume_attachments => generated 194 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:35:22.420922 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fbf67315-e93c-42ca-a340-96e5039fa686 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:22.421424 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fbf67315-e93c-42ca-a340-96e5039fa686 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:22.423940 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:22.424715 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=11 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:22.430992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fbf67315-e93c-42ca-a340-96e5039fa686 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:22.431446 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fbf67315-e93c-42ca-a340-96e5039fa686 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:22.432272 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fbf67315-e93c-42ca-a340-96e5039fa686 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:22.432719 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fbf67315-e93c-42ca-a340-96e5039fa686 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:22.522131 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-fbf67315-e93c-42ca-a340-96e5039fa686 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lazy-loading 'services' on Instance uuid 09fd2e57-5250-43c9-b8e6-4873e4caf351 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:35:22.800189 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fbf67315-e93c-42ca-a340-96e5039fa686 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "DELETE /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351/os-volume_attachments/57b7966f-66ad-420a-b226-6beb6de8e849" status: 202 len: 0 microversion: 2.1 time: 0.383928 May 19 12:35:22.800856 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 610/1136] 10.222.0.57 () {58 vars in 1415 bytes} [Thu May 19 12:35:22 2022] DELETE /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351/os-volume_attachments/57b7966f-66ad-420a-b226-6beb6de8e849 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:35:23.911486 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=15 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:23.912442 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:23.917027 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f5efd886-91d7-40db-9d30-cb360a70c2c4 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:23.917618 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f5efd886-91d7-40db-9d30-cb360a70c2c4 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:23.923811 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5efd886-91d7-40db-9d30-cb360a70c2c4 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:23.924273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5efd886-91d7-40db-9d30-cb360a70c2c4 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:23.925040 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5efd886-91d7-40db-9d30-cb360a70c2c4 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:23.925478 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f5efd886-91d7-40db-9d30-cb360a70c2c4 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:23.952041 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f5efd886-91d7-40db-9d30-cb360a70c2c4 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:35:24.338227 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f5efd886-91d7-40db-9d30-cb360a70c2c4 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "DELETE /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 204 len: 0 microversion: 2.1 time: 0.428102 May 19 12:35:24.338854 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 527/1137] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:35:23 2022] DELETE /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:35:24.347929 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ec8b5f66-c220-4e0b-a0cf-6cd0de3ce8ef tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:24.348710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ec8b5f66-c220-4e0b-a0cf-6cd0de3ce8ef tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:24.355959 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec8b5f66-c220-4e0b-a0cf-6cd0de3ce8ef tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:24.356484 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec8b5f66-c220-4e0b-a0cf-6cd0de3ce8ef tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:24.357248 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec8b5f66-c220-4e0b-a0cf-6cd0de3ce8ef tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:24.357684 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec8b5f66-c220-4e0b-a0cf-6cd0de3ce8ef tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:24.496238 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ec8b5f66-c220-4e0b-a0cf-6cd0de3ce8ef tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:24.503742 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ec8b5f66-c220-4e0b-a0cf-6cd0de3ce8ef tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1512 microversion: 2.1 time: 0.160450 May 19 12:35:24.504315 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 611/1138] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:35:24 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:35:25.521609 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-874dd8f1-bdbe-425d-805f-92f6db0bbd7a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:25.522433 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-874dd8f1-bdbe-425d-805f-92f6db0bbd7a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:25.530727 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-874dd8f1-bdbe-425d-805f-92f6db0bbd7a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:25.531250 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-874dd8f1-bdbe-425d-805f-92f6db0bbd7a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:25.532094 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-874dd8f1-bdbe-425d-805f-92f6db0bbd7a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:25.532462 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-874dd8f1-bdbe-425d-805f-92f6db0bbd7a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:25.668489 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-874dd8f1-bdbe-425d-805f-92f6db0bbd7a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:25.676077 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-874dd8f1-bdbe-425d-805f-92f6db0bbd7a tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1512 microversion: 2.1 time: 0.158736 May 19 12:35:25.676653 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 528/1139] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:35:25 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:35:26.695212 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-22084349-c1ca-4f61-b06a-fb6a5dab1024 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:26.695915 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-22084349-c1ca-4f61-b06a-fb6a5dab1024 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:26.702897 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-22084349-c1ca-4f61-b06a-fb6a5dab1024 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:26.704001 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-22084349-c1ca-4f61-b06a-fb6a5dab1024 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:26.704108 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-22084349-c1ca-4f61-b06a-fb6a5dab1024 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:26.704529 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-22084349-c1ca-4f61-b06a-fb6a5dab1024 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:26.910271 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-22084349-c1ca-4f61-b06a-fb6a5dab1024 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:26.918677 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-22084349-c1ca-4f61-b06a-fb6a5dab1024 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1512 microversion: 2.1 time: 0.229249 May 19 12:35:26.919344 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 612/1140] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:35:26 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:35:27.266791 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-e7321966-3864-4552-bb50-e05238a44d9f req-fdbef46c-f0fa-4ee0-9cc2-f364924297e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09fd2e57-5250-43c9-b8e6-4873e4caf351", "name": "network-vif-deleted", "tag": "24c2206f-53eb-4f5e-aba8-c7f6b0ab6640"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:35:27.275638 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-e7321966-3864-4552-bb50-e05238a44d9f req-fdbef46c-f0fa-4ee0-9cc2-f364924297e3 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:27.276083 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-e7321966-3864-4552-bb50-e05238a44d9f req-fdbef46c-f0fa-4ee0-9cc2-f364924297e3 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:27.286956 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-e7321966-3864-4552-bb50-e05238a44d9f req-fdbef46c-f0fa-4ee0-9cc2-f364924297e3 service nova] Creating event network-vif-deleted:24c2206f-53eb-4f5e-aba8-c7f6b0ab6640 for instance 09fd2e57-5250-43c9-b8e6-4873e4caf351 on hv-cinder-77819 May 19 12:35:27.292940 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-e7321966-3864-4552-bb50-e05238a44d9f req-fdbef46c-f0fa-4ee0-9cc2-f364924297e3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149489 May 19 12:35:27.293550 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 529/1141] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:35:27.936110 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4ae6977a-4e1f-4e65-9b73-f04b1f6f8aba tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:27.937599 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4ae6977a-4e1f-4e65-9b73-f04b1f6f8aba tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:27.943308 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ae6977a-4e1f-4e65-9b73-f04b1f6f8aba tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:27.943747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ae6977a-4e1f-4e65-9b73-f04b1f6f8aba tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:27.945077 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ae6977a-4e1f-4e65-9b73-f04b1f6f8aba tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:27.945508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ae6977a-4e1f-4e65-9b73-f04b1f6f8aba tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:27.976578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ae6977a-4e1f-4e65-9b73-f04b1f6f8aba tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:27.977027 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ae6977a-4e1f-4e65-9b73-f04b1f6f8aba tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:27.977476 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-4ae6977a-4e1f-4e65-9b73-f04b1f6f8aba tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lazy-loading 'fault' on Instance uuid 09fd2e57-5250-43c9-b8e6-4873e4caf351 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:35:28.018979 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4ae6977a-4e1f-4e65-9b73-f04b1f6f8aba tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f609cfe0d7a4ded8a622c65d8690f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '886ee445e38e4c31bd4d4d014a7c4c7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:28.026760 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4ae6977a-4e1f-4e65-9b73-f04b1f6f8aba tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 200 len: 1308 microversion: 2.1 time: 0.094312 May 19 12:35:28.027263 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 613/1142] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:35:27 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:35:29.045121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-25c48fa3-db66-4fd2-9ee6-5025bb2f7253 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:29.055600 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-25c48fa3-db66-4fd2-9ee6-5025bb2f7253 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] [instance: 09fd2e57-5250-43c9-b8e6-4873e4caf351] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:29.055600 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25c48fa3-db66-4fd2-9ee6-5025bb2f7253 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:29.055600 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25c48fa3-db66-4fd2-9ee6-5025bb2f7253 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:29.055600 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25c48fa3-db66-4fd2-9ee6-5025bb2f7253 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:29.056334 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-25c48fa3-db66-4fd2-9ee6-5025bb2f7253 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:29.068315 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-25c48fa3-db66-4fd2-9ee6-5025bb2f7253 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] HTTP exception thrown: Instance 09fd2e57-5250-43c9-b8e6-4873e4caf351 could not be found. May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-25c48fa3-db66-4fd2-9ee6-5025bb2f7253 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Request method failure captured: May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 HTTP/1.1 May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjjfXM5XWqJsbnz-wXZY1zTXfOIFS5mDyYtyjkypPayz-wr4S-aXYy7p3JRnBxkN6G1z__fdcZtqfoy1Ndb8CjSNj16CEhlKOQR7hY-9P50ND-rJdKb8ozUfW34qOOtS0wEIWQhB8gGYdh2f5oNZcYYjiX2leAWbEEzGrAGaF2SK7dY May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 886ee445e38e4c31bd4d4d014a7c4c7c May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1695631288 May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:35:29.070590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:35:29.072269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/886ee445e38e4c31bd4d4d014a7c4c7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/886ee445e38e4c31bd4d4d014a7c4c7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/886ee445e38e4c31bd4d4d014a7c4c7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_886ee445e38e4c31bd4d4d014a7c4c7c", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:35:29.072269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesSnapshotTestJSON-1695631288 May 19 12:35:29.072269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 886ee445e38e4c31bd4d4d014a7c4c7c May 19 12:35:29.072269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1695631288 May 19 12:35:29.072269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesSnapshotTestJSON-1695631288-project May 19 12:35:29.072269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:35:29.072269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:35:29.072269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 8f609cfe0d7a4ded8a622c65d8690f7f May 19 12:35:29.072269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesSnapshotTestJSON-1695631288-project May 19 12:35:29.072269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:35:29.072269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance 09fd2e57-5250-43c9-b8e6-4873e4caf351 could not be found. May 19 12:35:29.072269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '09fd2e57-5250-43c9-b8e6-4873e4caf351'} May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09fd2e57-5250-43c9-b8e6-4873e4caf351 could not be found. May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:35:29.073191 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09fd2e57-5250-43c9-b8e6-4873e4caf351 could not be found. May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09fd2e57-5250-43c9-b8e6-4873e4caf351 could not be found. May 19 12:35:29.074742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:35:29.075856 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-25c48fa3-db66-4fd2-9ee6-5025bb2f7253 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] Returning 404 to user: Instance 09fd2e57-5250-43c9-b8e6-4873e4caf351 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:35:29.075856 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-25c48fa3-db66-4fd2-9ee6-5025bb2f7253 tempest-VolumesSnapshotTestJSON-1695631288 tempest-VolumesSnapshotTestJSON-1695631288-project] 10.222.0.57 "GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351" status: 404 len: 111 microversion: 2.1 time: 0.031541 May 19 12:35:29.075856 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 530/1143] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:35:29 2022] GET /compute/v2.1/servers/09fd2e57-5250-43c9-b8e6-4873e4caf351 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:35:54.783187 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-7a1a02b8-fd78-4c57-a8ac-8bef8208048d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:54.784236 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-7a1a02b8-fd78-4c57-a8ac-8bef8208048d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:54.786583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=10 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:54.787248 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:54.793333 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7a1a02b8-fd78-4c57-a8ac-8bef8208048d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:54.793762 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7a1a02b8-fd78-4c57-a8ac-8bef8208048d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:54.794560 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7a1a02b8-fd78-4c57-a8ac-8bef8208048d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:54.795126 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7a1a02b8-fd78-4c57-a8ac-8bef8208048d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:54.825386 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-7a1a02b8-fd78-4c57-a8ac-8bef8208048d tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047227 May 19 12:35:54.825978 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 614/1144] 10.222.0.57 () {60 vars in 1342 bytes} [Thu May 19 12:35:54 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:35:54.886003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-40fbfbdc-e53e-4287-9d2b-264cf05900e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:54.891733 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-40fbfbdc-e53e-4287-9d2b-264cf05900e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:54.891733 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:54.891733 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:35:54.895351 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40fbfbdc-e53e-4287-9d2b-264cf05900e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:54.895793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40fbfbdc-e53e-4287-9d2b-264cf05900e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:54.896557 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40fbfbdc-e53e-4287-9d2b-264cf05900e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:54.896988 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-40fbfbdc-e53e-4287-9d2b-264cf05900e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:54.925730 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-40fbfbdc-e53e-4287-9d2b-264cf05900e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:35:55.314604 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-40fbfbdc-e53e-4287-9d2b-264cf05900e6 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "DELETE /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 204 len: 0 microversion: 2.20 time: 0.432247 May 19 12:35:55.314993 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 531/1145] 10.222.0.57 () {60 vars in 1279 bytes} [Thu May 19 12:35:54 2022] DELETE /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 12:35:55.334360 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-24d11c89-c8af-4ce7-8867-0d7b200a336e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:55.334996 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-24d11c89-c8af-4ce7-8867-0d7b200a336e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:55.342290 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-24d11c89-c8af-4ce7-8867-0d7b200a336e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:55.342772 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-24d11c89-c8af-4ce7-8867-0d7b200a336e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:55.343533 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-24d11c89-c8af-4ce7-8867-0d7b200a336e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:55.343970 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-24d11c89-c8af-4ce7-8867-0d7b200a336e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:55.481383 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-24d11c89-c8af-4ce7-8867-0d7b200a336e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:55.489811 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-24d11c89-c8af-4ce7-8867-0d7b200a336e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:55.491350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-24d11c89-c8af-4ce7-8867-0d7b200a336e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:55.493260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-24d11c89-c8af-4ce7-8867-0d7b200a336e tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1723 microversion: 2.20 time: 0.163346 May 19 12:35:55.496235 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 615/1146] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:35:55 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:35:56.514786 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-da6e4260-91d4-433c-a8d6-b9a5db0eefaa tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:56.515486 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-da6e4260-91d4-433c-a8d6-b9a5db0eefaa tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:56.522695 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da6e4260-91d4-433c-a8d6-b9a5db0eefaa tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:56.523181 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da6e4260-91d4-433c-a8d6-b9a5db0eefaa tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:56.523999 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da6e4260-91d4-433c-a8d6-b9a5db0eefaa tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:56.524981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da6e4260-91d4-433c-a8d6-b9a5db0eefaa tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:56.667380 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-da6e4260-91d4-433c-a8d6-b9a5db0eefaa tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:56.675427 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-da6e4260-91d4-433c-a8d6-b9a5db0eefaa tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:56.676913 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-da6e4260-91d4-433c-a8d6-b9a5db0eefaa tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:56.678078 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-da6e4260-91d4-433c-a8d6-b9a5db0eefaa tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1723 microversion: 2.20 time: 0.167658 May 19 12:35:56.678667 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 532/1147] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:35:56 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:35:57.701569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ff7516b0-d449-43fa-a091-7e19c5f71db2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:57.702212 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ff7516b0-d449-43fa-a091-7e19c5f71db2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:57.713545 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ff7516b0-d449-43fa-a091-7e19c5f71db2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:57.714205 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ff7516b0-d449-43fa-a091-7e19c5f71db2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:57.715009 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ff7516b0-d449-43fa-a091-7e19c5f71db2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:57.715443 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ff7516b0-d449-43fa-a091-7e19c5f71db2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:57.815525 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ff7516b0-d449-43fa-a091-7e19c5f71db2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:57.823846 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ff7516b0-d449-43fa-a091-7e19c5f71db2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:57.830082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ff7516b0-d449-43fa-a091-7e19c5f71db2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:57.830082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ff7516b0-d449-43fa-a091-7e19c5f71db2 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1656 microversion: 2.20 time: 0.133558 May 19 12:35:57.830082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 616/1148] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:35:57 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1656 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:35:58.000640 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-ed23eb63-ef53-4397-bcde-57012494a850 req-9f37f98f-bf31-4166-bd2f-3c352d7f846c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366b434a-af2f-4b06-beda-5bb9b4816e66", "name": "network-vif-deleted", "tag": "aa50357b-95ff-4657-bbc2-3b5dd21e899e"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:35:58.012589 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ed23eb63-ef53-4397-bcde-57012494a850 req-9f37f98f-bf31-4166-bd2f-3c352d7f846c service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:58.013270 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ed23eb63-ef53-4397-bcde-57012494a850 req-9f37f98f-bf31-4166-bd2f-3c352d7f846c service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:58.049787 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-ed23eb63-ef53-4397-bcde-57012494a850 req-9f37f98f-bf31-4166-bd2f-3c352d7f846c service nova] Creating event network-vif-deleted:aa50357b-95ff-4657-bbc2-3b5dd21e899e for instance 366b434a-af2f-4b06-beda-5bb9b4816e66 on hv-cinder-77819 May 19 12:35:58.060397 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-ed23eb63-ef53-4397-bcde-57012494a850 req-9f37f98f-bf31-4166-bd2f-3c352d7f846c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063065 May 19 12:35:58.061016 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 533/1149] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:35:58.845874 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5c20a103-26b8-401c-b4f5-99f34a641686 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:58.847238 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-5c20a103-26b8-401c-b4f5-99f34a641686 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:58.853033 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5c20a103-26b8-401c-b4f5-99f34a641686 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:58.853484 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5c20a103-26b8-401c-b4f5-99f34a641686 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:58.854266 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5c20a103-26b8-401c-b4f5-99f34a641686 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:58.854850 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5c20a103-26b8-401c-b4f5-99f34a641686 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:58.889783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5c20a103-26b8-401c-b4f5-99f34a641686 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:58.890244 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-5c20a103-26b8-401c-b4f5-99f34a641686 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:58.891100 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-5c20a103-26b8-401c-b4f5-99f34a641686 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lazy-loading 'fault' on Instance uuid 366b434a-af2f-4b06-beda-5bb9b4816e66 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:35:58.937973 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5c20a103-26b8-401c-b4f5-99f34a641686 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:58.946714 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5c20a103-26b8-401c-b4f5-99f34a641686 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:58.948244 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-5c20a103-26b8-401c-b4f5-99f34a641686 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '746a70534fe5419ebe6d5e97a7a041f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1231585c94524ec199c47bd4f4162578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:35:58.950176 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5c20a103-26b8-401c-b4f5-99f34a641686 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 200 len: 1372 microversion: 2.20 time: 0.108091 May 19 12:35:58.951089 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 617/1150] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:35:58 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 12:35:59.969463 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-59498a68-8d8f-404f-a086-1c6b37beebcd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:35:59.970147 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-59498a68-8d8f-404f-a086-1c6b37beebcd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:35:59.976474 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-59498a68-8d8f-404f-a086-1c6b37beebcd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:59.976919 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-59498a68-8d8f-404f-a086-1c6b37beebcd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:59.977676 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-59498a68-8d8f-404f-a086-1c6b37beebcd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:35:59.978162 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-59498a68-8d8f-404f-a086-1c6b37beebcd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:35:59.991952 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-59498a68-8d8f-404f-a086-1c6b37beebcd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] HTTP exception thrown: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-59498a68-8d8f-404f-a086-1c6b37beebcd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Request method failure captured: May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 HTTP/1.1 May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjb_pA3YbFvgpYeHEaLyARNwGe1_6vmlClchqkfb-wUW-87GPWnT_vFt38C5VPmskKLe8Tzko2xBrpkDZDmMJVWHsn2Y4WAFiaUQMl5fYAXltmMPR2JmCQqvZnS-HYBMvIcsc780v-Mv5WvRs2kPR6xpuLuhA0mMTwflCpNF9vaJg7U May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Openstack-Nova-Api-Version: 2.20 May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 1231585c94524ec199c47bd4f4162578 May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:35:59.993642 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:35:59.995490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1231585c94524ec199c47bd4f4162578"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1231585c94524ec199c47bd4f4162578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1231585c94524ec199c47bd4f4162578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1231585c94524ec199c47bd4f4162578", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:35:59.995490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:35:59.995490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 1231585c94524ec199c47bd4f4162578 May 19 12:35:59.995490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:35:59.995490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeShelveTestJSON-1308427986-project May 19 12:35:59.995490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:35:59.995490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:35:59.995490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 746a70534fe5419ebe6d5e97a7a041f1 May 19 12:35:59.995490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1308427986-project May 19 12:35:59.995490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:35:59.995490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:35:59.995490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '366b434a-af2f-4b06-beda-5bb9b4816e66'} May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:35:59.997160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:36:00.000685 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:00.001940 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-59498a68-8d8f-404f-a086-1c6b37beebcd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Returning 404 to user: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:36:00.001940 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-59498a68-8d8f-404f-a086-1c6b37beebcd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 404 len: 111 microversion: 2.20 time: 0.031247 May 19 12:36:00.001940 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 534/1151] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:35:59 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 12:36:00.004897 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-234d00f0-b4ee-4a37-a805-e09432f61d8b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '.version_select at 0x7fd45562c3a0>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:36:00.076065 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-234d00f0-b4ee-4a37-a805-e09432f61d8b tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646212378" status: 204 len: 0 microversion: 2.20 time: 0.075141 May 19 12:36:00.076865 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 618/1152] 10.222.0.57 () {60 vars in 1261 bytes} [Thu May 19 12:35:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646212378 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 12:36:02.522370 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-13f7a856-84b1-4ddb-8f07-8653351acdfd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:36:02.522902 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-13f7a856-84b1-4ddb-8f07-8653351acdfd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:36:02.529641 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-13f7a856-84b1-4ddb-8f07-8653351acdfd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:02.530081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-13f7a856-84b1-4ddb-8f07-8653351acdfd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:02.530894 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-13f7a856-84b1-4ddb-8f07-8653351acdfd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:02.531462 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-13f7a856-84b1-4ddb-8f07-8653351acdfd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:02.546264 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-13f7a856-84b1-4ddb-8f07-8653351acdfd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] HTTP exception thrown: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-13f7a856-84b1-4ddb-8f07-8653351acdfd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Request method failure captured: May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 HTTP/1.1 May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjb_pA3YbFvgpYeHEaLyARNwGe1_6vmlClchqkfb-wUW-87GPWnT_vFt38C5VPmskKLe8Tzko2xBrpkDZDmMJVWHsn2Y4WAFiaUQMl5fYAXltmMPR2JmCQqvZnS-HYBMvIcsc780v-Mv5WvRs2kPR6xpuLuhA0mMTwflCpNF9vaJg7U May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Openstack-Nova-Api-Version: 2.20 May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 1231585c94524ec199c47bd4f4162578 May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:36:02.548170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:36:02.550029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1231585c94524ec199c47bd4f4162578"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1231585c94524ec199c47bd4f4162578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1231585c94524ec199c47bd4f4162578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1231585c94524ec199c47bd4f4162578", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:36:02.550029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:36:02.550029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 1231585c94524ec199c47bd4f4162578 May 19 12:36:02.550029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:36:02.550029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeShelveTestJSON-1308427986-project May 19 12:36:02.550029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:36:02.550029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:36:02.550029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 746a70534fe5419ebe6d5e97a7a041f1 May 19 12:36:02.550029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1308427986-project May 19 12:36:02.550029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:36:02.550029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:36:02.550029 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '366b434a-af2f-4b06-beda-5bb9b4816e66'} May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:36:02.551006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:36:02.552408 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:02.554380 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-13f7a856-84b1-4ddb-8f07-8653351acdfd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Returning 404 to user: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:36:02.554380 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-13f7a856-84b1-4ddb-8f07-8653351acdfd tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "DELETE /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 404 len: 111 microversion: 2.20 time: 0.031262 May 19 12:36:02.554380 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 535/1153] 10.222.0.57 () {60 vars in 1279 bytes} [Thu May 19 12:36:02 2022] DELETE /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 12:36:02.560322 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-71e5c755-3069-4d14-9437-fbc0f5490775 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:36:02.560924 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-71e5c755-3069-4d14-9437-fbc0f5490775 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 366b434a-af2f-4b06-beda-5bb9b4816e66] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:36:02.567960 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-71e5c755-3069-4d14-9437-fbc0f5490775 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:02.568413 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-71e5c755-3069-4d14-9437-fbc0f5490775 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:02.569330 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-71e5c755-3069-4d14-9437-fbc0f5490775 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:02.569759 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-71e5c755-3069-4d14-9437-fbc0f5490775 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:02.584576 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-71e5c755-3069-4d14-9437-fbc0f5490775 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] HTTP exception thrown: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-71e5c755-3069-4d14-9437-fbc0f5490775 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Request method failure captured: May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 HTTP/1.1 May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb_pA3YbFvgpYeHEaLyARNwGe1_6vmlClchqkfb-wUW-87GPWnT_vFt38C5VPmskKLe8Tzko2xBrpkDZDmMJVWHsn2Y4WAFiaUQMl5fYAXltmMPR2JmCQqvZnS-HYBMvIcsc780v-Mv5WvRs2kPR6xpuLuhA0mMTwflCpNF9vaJg7U May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Openstack-Nova-Api-Version: 2.20 May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 1231585c94524ec199c47bd4f4162578 May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:36:02.586297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:36:02.587912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1231585c94524ec199c47bd4f4162578"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1231585c94524ec199c47bd4f4162578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1231585c94524ec199c47bd4f4162578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1231585c94524ec199c47bd4f4162578", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:36:02.587912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:36:02.587912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 1231585c94524ec199c47bd4f4162578 May 19 12:36:02.587912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:36:02.587912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeShelveTestJSON-1308427986-project May 19 12:36:02.587912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:36:02.587912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:36:02.587912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 746a70534fe5419ebe6d5e97a7a041f1 May 19 12:36:02.587912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1308427986-project May 19 12:36:02.587912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:36:02.587912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:36:02.587912 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '366b434a-af2f-4b06-beda-5bb9b4816e66'} May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:36:02.588682 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. May 19 12:36:02.590338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:02.591967 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-71e5c755-3069-4d14-9437-fbc0f5490775 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Returning 404 to user: Instance 366b434a-af2f-4b06-beda-5bb9b4816e66 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:36:02.591967 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-71e5c755-3069-4d14-9437-fbc0f5490775 tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66" status: 404 len: 111 microversion: 2.20 time: 0.032899 May 19 12:36:02.591967 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 619/1154] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:36:02 2022] GET /compute/v2.1/servers/366b434a-af2f-4b06-beda-5bb9b4816e66 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 12:36:03.880020 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e3c5f53b-9770-4b4c-9312-f0d7e714f23f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:36:03.880020 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e3c5f53b-9770-4b4c-9312-f0d7e714f23f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:36:03.885465 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e3c5f53b-9770-4b4c-9312-f0d7e714f23f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:03.886120 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e3c5f53b-9770-4b4c-9312-f0d7e714f23f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:03.887848 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e3c5f53b-9770-4b4c-9312-f0d7e714f23f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:03.888413 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e3c5f53b-9770-4b4c-9312-f0d7e714f23f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:03.903223 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-e3c5f53b-9770-4b4c-9312-f0d7e714f23f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] HTTP exception thrown: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e3c5f53b-9770-4b4c-9312-f0d7e714f23f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Request method failure captured: May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 HTTP/1.1 May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjb_pA3YbFvgpYeHEaLyARNwGe1_6vmlClchqkfb-wUW-87GPWnT_vFt38C5VPmskKLe8Tzko2xBrpkDZDmMJVWHsn2Y4WAFiaUQMl5fYAXltmMPR2JmCQqvZnS-HYBMvIcsc780v-Mv5WvRs2kPR6xpuLuhA0mMTwflCpNF9vaJg7U May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Openstack-Nova-Api-Version: 2.20 May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 1231585c94524ec199c47bd4f4162578 May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:36:03.904774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:36:03.906372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1231585c94524ec199c47bd4f4162578"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1231585c94524ec199c47bd4f4162578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1231585c94524ec199c47bd4f4162578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1231585c94524ec199c47bd4f4162578", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:36:03.906372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:36:03.906372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 1231585c94524ec199c47bd4f4162578 May 19 12:36:03.906372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:36:03.906372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeShelveTestJSON-1308427986-project May 19 12:36:03.906372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:36:03.906372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:36:03.906372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 746a70534fe5419ebe6d5e97a7a041f1 May 19 12:36:03.906372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1308427986-project May 19 12:36:03.906372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:36:03.906372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:36:03.906372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '1ac0842f-dd21-479d-894c-1080f1531013'} May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:36:03.907172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:36:03.908382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:03.910139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e3c5f53b-9770-4b4c-9312-f0d7e714f23f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Returning 404 to user: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:36:03.910139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e3c5f53b-9770-4b4c-9312-f0d7e714f23f tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 404 len: 111 microversion: 2.20 time: 0.039496 May 19 12:36:03.910139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 536/1155] 10.222.0.57 () {60 vars in 1279 bytes} [Thu May 19 12:36:03 2022] DELETE /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 12:36:03.914714 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-050b14d6-880c-4278-818e-ff85967b35eb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:36:03.915321 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-050b14d6-880c-4278-818e-ff85967b35eb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] [instance: 1ac0842f-dd21-479d-894c-1080f1531013] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:36:03.921834 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-050b14d6-880c-4278-818e-ff85967b35eb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:03.922284 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-050b14d6-880c-4278-818e-ff85967b35eb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:03.923081 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-050b14d6-880c-4278-818e-ff85967b35eb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:03.923518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-050b14d6-880c-4278-818e-ff85967b35eb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:03.937411 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-050b14d6-880c-4278-818e-ff85967b35eb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] HTTP exception thrown: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-050b14d6-880c-4278-818e-ff85967b35eb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Request method failure captured: May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 HTTP/1.1 May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb_pA3YbFvgpYeHEaLyARNwGe1_6vmlClchqkfb-wUW-87GPWnT_vFt38C5VPmskKLe8Tzko2xBrpkDZDmMJVWHsn2Y4WAFiaUQMl5fYAXltmMPR2JmCQqvZnS-HYBMvIcsc780v-Mv5WvRs2kPR6xpuLuhA0mMTwflCpNF9vaJg7U May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Openstack-Nova-Api-Version: 2.20 May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 1231585c94524ec199c47bd4f4162578 May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:36:03.948653 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:36:03.950992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1231585c94524ec199c47bd4f4162578"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/1231585c94524ec199c47bd4f4162578"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/1231585c94524ec199c47bd4f4162578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_1231585c94524ec199c47bd4f4162578", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:36:03.950992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:36:03.950992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 1231585c94524ec199c47bd4f4162578 May 19 12:36:03.950992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1308427986 May 19 12:36:03.950992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeShelveTestJSON-1308427986-project May 19 12:36:03.950992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:36:03.950992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:36:03.950992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 746a70534fe5419ebe6d5e97a7a041f1 May 19 12:36:03.950992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1308427986-project May 19 12:36:03.950992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:36:03.950992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:36:03.950992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '1ac0842f-dd21-479d-894c-1080f1531013'} May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:36:03.951928 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. May 19 12:36:03.953710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:03.955029 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-050b14d6-880c-4278-818e-ff85967b35eb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] Returning 404 to user: Instance 1ac0842f-dd21-479d-894c-1080f1531013 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:36:03.955029 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-050b14d6-880c-4278-818e-ff85967b35eb tempest-AttachVolumeShelveTestJSON-1308427986 tempest-AttachVolumeShelveTestJSON-1308427986-project] 10.222.0.57 "GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013" status: 404 len: 111 microversion: 2.20 time: 0.029449 May 19 12:36:03.955029 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 620/1156] 10.222.0.57 () {60 vars in 1276 bytes} [Thu May 19 12:36:03 2022] GET /compute/v2.1/servers/1ac0842f-dd21-479d-894c-1080f1531013 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 12:36:09.881535 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1039e822-f372-4bbe-873a-1e2bbc42c858 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Action: 'create', calling method: .version_select at 0x7fd4550f1700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-851050424", "metadata": {"Type": "work"}}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1039e822-f372-4bbe-873a-1e2bbc42c858 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Request method failure captured: May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 121 May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjm5y7pQ8uoI4dM-RA0DymDSBPu2ERNPIpjkAuxBBs8yNhJU6IwdgU4Rk9ToRZ0-WkZnUb-8vWU2FSnA11IUdYKOcWWn5cYHVm8e1r1I058AMuFBiTFh-X1FO1VMrvprmS320cB1n44osHEjRi9pYwn-7ZE_lVX0c_P62fL5iK9ybB8 May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: e58d2ae3ee1b45cbac9cbb69bc198031 May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesNegativeTest-590533151 May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:36:09.902833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:36:09.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e58d2ae3ee1b45cbac9cbb69bc198031", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:36:09.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesNegativeTest-590533151 May 19 12:36:09.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: e58d2ae3ee1b45cbac9cbb69bc198031 May 19 12:36:09.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesNegativeTest-590533151 May 19 12:36:09.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesNegativeTest-590533151-project May 19 12:36:09.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:36:09.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:36:09.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: ea2d1d60221d4d98a5baccc7d53db654 May 19 12:36:09.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesNegativeTest-590533151-project May 19 12:36:09.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: May 19 12:36:09.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-851050424", "metadata": {"Type": "work"}}} May 19 12:36:09.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: May 19 12:36:09.904603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-851050424', 'metadata': {'Type': 'work'}}}} May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise error May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi '#$%' May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:36:09.905623 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 12:36:09.907230 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 12:36:09.908507 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 12:36:09.908507 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.908507 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1039e822-f372-4bbe-873a-1e2bbc42c858 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:36:09.908507 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1039e822-f372-4bbe-873a-1e2bbc42c858 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.171035 May 19 12:36:09.908507 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 537/1157] 10.222.0.57 () {60 vars in 1155 bytes} [Thu May 19 12:36:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 12:36:09.913896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-cd42bd60-71c9-42be-94f2-3bbf14244c39 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Action: 'create', calling method: .version_select at 0x7fd45562c820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-592790678", "metadata": {"Type": "work"}}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-cd42bd60-71c9-42be-94f2-3bbf14244c39 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Request method failure captured: May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 119 May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjm5y7pQ8uoI4dM-RA0DymDSBPu2ERNPIpjkAuxBBs8yNhJU6IwdgU4Rk9ToRZ0-WkZnUb-8vWU2FSnA11IUdYKOcWWn5cYHVm8e1r1I058AMuFBiTFh-X1FO1VMrvprmS320cB1n44osHEjRi9pYwn-7ZE_lVX0c_P62fL5iK9ybB8 May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: e58d2ae3ee1b45cbac9cbb69bc198031 May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-VolumesNegativeTest-590533151 May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:36:09.917224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:36:09.918814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e58d2ae3ee1b45cbac9cbb69bc198031", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:36:09.918814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-VolumesNegativeTest-590533151 May 19 12:36:09.918814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: e58d2ae3ee1b45cbac9cbb69bc198031 May 19 12:36:09.918814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-VolumesNegativeTest-590533151 May 19 12:36:09.918814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-VolumesNegativeTest-590533151-project May 19 12:36:09.918814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:36:09.918814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:36:09.918814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: ea2d1d60221d4d98a5baccc7d53db654 May 19 12:36:09.918814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-VolumesNegativeTest-590533151-project May 19 12:36:09.918814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: May 19 12:36:09.918814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-592790678", "metadata": {"Type": "work"}}} May 19 12:36:09.918814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: May 19 12:36:09.918814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-592790678', 'metadata': {'Type': 'work'}}}} May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise error May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi '0' May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:36:09.919783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 12:36:09.921162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 12:36:09.923753 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 12:36:09.923753 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.923753 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-cd42bd60-71c9-42be-94f2-3bbf14244c39 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:36:09.923753 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-cd42bd60-71c9-42be-94f2-3bbf14244c39 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008521 May 19 12:36:09.923753 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 621/1158] 10.222.0.57 () {60 vars in 1155 bytes} [Thu May 19 12:36:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 12:36:09.928837 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b79ac7ca-6335-48ee-82af-d5bc74feefb2 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Action: 'create', calling method: .version_select at 0x7fd45a91f700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1002150119", "metadata": {"Type": "work"}}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b79ac7ca-6335-48ee-82af-d5bc74feefb2 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Request method failure captured: May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 119 May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjm5y7pQ8uoI4dM-RA0DymDSBPu2ERNPIpjkAuxBBs8yNhJU6IwdgU4Rk9ToRZ0-WkZnUb-8vWU2FSnA11IUdYKOcWWn5cYHVm8e1r1I058AMuFBiTFh-X1FO1VMrvprmS320cB1n44osHEjRi9pYwn-7ZE_lVX0c_P62fL5iK9ybB8 May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: e58d2ae3ee1b45cbac9cbb69bc198031 May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesNegativeTest-590533151 May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:36:09.932504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:36:09.934702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e58d2ae3ee1b45cbac9cbb69bc198031", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:36:09.934702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesNegativeTest-590533151 May 19 12:36:09.934702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: e58d2ae3ee1b45cbac9cbb69bc198031 May 19 12:36:09.934702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesNegativeTest-590533151 May 19 12:36:09.934702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesNegativeTest-590533151-project May 19 12:36:09.934702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:36:09.934702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:36:09.934702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: ea2d1d60221d4d98a5baccc7d53db654 May 19 12:36:09.934702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesNegativeTest-590533151-project May 19 12:36:09.934702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: May 19 12:36:09.934702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1002150119", "metadata": {"Type": "work"}}} May 19 12:36:09.934702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: May 19 12:36:09.934702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1002150119', 'metadata': {'Type': 'work'}}}} May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise error May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi '' May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:36:09.935752 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 12:36:09.937313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 12:36:09.938758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 12:36:09.938758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:09.938758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b79ac7ca-6335-48ee-82af-d5bc74feefb2 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:36:09.938758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b79ac7ca-6335-48ee-82af-d5bc74feefb2 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010615 May 19 12:36:09.938758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 538/1159] 10.222.0.57 () {60 vars in 1155 bytes} [Thu May 19 12:36:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 12:36:09.946230 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b90da588-cc14-4773-aed7-fc25eadce961 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Calling method '.version_select at 0x7fd45574fdc0>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:36:09.975036 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-b90da588-cc14-4773-aed7-fc25eadce961 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] HTTP exception thrown: Volume tempest-invalid-1461420599 could not be found. May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b90da588-cc14-4773-aed7-fc25eadce961 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Request method failure captured: May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1461420599 HTTP/1.1 May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjm5y7pQ8uoI4dM-RA0DymDSBPu2ERNPIpjkAuxBBs8yNhJU6IwdgU4Rk9ToRZ0-WkZnUb-8vWU2FSnA11IUdYKOcWWn5cYHVm8e1r1I058AMuFBiTFh-X1FO1VMrvprmS320cB1n44osHEjRi9pYwn-7ZE_lVX0c_P62fL5iK9ybB8 May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: e58d2ae3ee1b45cbac9cbb69bc198031 May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-VolumesNegativeTest-590533151 May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:36:09.978313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:36:09.979858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e58d2ae3ee1b45cbac9cbb69bc198031", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:36:09.979858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-VolumesNegativeTest-590533151 May 19 12:36:09.979858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: e58d2ae3ee1b45cbac9cbb69bc198031 May 19 12:36:09.979858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-VolumesNegativeTest-590533151 May 19 12:36:09.979858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-VolumesNegativeTest-590533151-project May 19 12:36:09.979858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:36:09.979858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:36:09.979858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: ea2d1d60221d4d98a5baccc7d53db654 May 19 12:36:09.979858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-VolumesNegativeTest-590533151-project May 19 12:36:09.979858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: May 19 12:36:09.979858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Volume tempest-invalid-1461420599 could not be found. May 19 12:36:09.979858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': 'tempest-invalid-1461420599'} May 19 12:36:09.979858 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1461420599 could not be found. (HTTP 404) (Request-ID: req-f576ec35-6bb4-415c-82af-3aa1e1b85a2e) May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:09.980988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 12:36:09.982471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1461420599 could not be found. May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:36:09.983727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1461420599 could not be found. May 19 12:36:09.985508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.985508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:09.985508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.985508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:09.985508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:09.985508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:09.985508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:36:09.985508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:36:09.985508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1461420599 could not be found. May 19 12:36:09.985508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:09.985508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b90da588-cc14-4773-aed7-fc25eadce961 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Returning 404 to user: Volume tempest-invalid-1461420599 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:36:09.985508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b90da588-cc14-4773-aed7-fc25eadce961 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1461420599" status: 404 len: 99 microversion: 2.1 time: 0.037956 May 19 12:36:09.985508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 622/1160] 10.222.0.57 () {58 vars in 1217 bytes} [Thu May 19 12:36:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1461420599 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 12:36:09.989207 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7e31d8d3-2aa4-4ded-8715-22b1e89ff05d tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003826 May 19 12:36:09.989700 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 539/1161] 10.222.0.57 () {58 vars in 1139 bytes} [Thu May 19 12:36:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 12:36:09.998576 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-20eb4391-8f0a-4bbe-876b-1700794b600f tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004249 May 19 12:36:09.999067 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 623/1162] 10.222.0.57 () {58 vars in 1136 bytes} [Thu May 19 12:36:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 12:36:10.006865 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5650aff4-f8d1-4bc4-bce8-2e387e858bc8 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Calling method '.version_select at 0x7fd4551568b0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:36:10.035433 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-5650aff4-f8d1-4bc4-bce8-2e387e858bc8 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] HTTP exception thrown: Volume 654bf4c1-ab7a-4494-b963-4fff933b94a9 could not be found. May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5650aff4-f8d1-4bc4-bce8-2e387e858bc8 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Request method failure captured: May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/os-volumes/654bf4c1-ab7a-4494-b963-4fff933b94a9 HTTP/1.1 May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjm5y7pQ8uoI4dM-RA0DymDSBPu2ERNPIpjkAuxBBs8yNhJU6IwdgU4Rk9ToRZ0-WkZnUb-8vWU2FSnA11IUdYKOcWWn5cYHVm8e1r1I058AMuFBiTFh-X1FO1VMrvprmS320cB1n44osHEjRi9pYwn-7ZE_lVX0c_P62fL5iK9ybB8 May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: e58d2ae3ee1b45cbac9cbb69bc198031 May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-VolumesNegativeTest-590533151 May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:36:10.037445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:36:10.039001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e58d2ae3ee1b45cbac9cbb69bc198031", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:36:10.039001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-VolumesNegativeTest-590533151 May 19 12:36:10.039001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: e58d2ae3ee1b45cbac9cbb69bc198031 May 19 12:36:10.039001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-VolumesNegativeTest-590533151 May 19 12:36:10.039001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-VolumesNegativeTest-590533151-project May 19 12:36:10.039001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:36:10.039001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:36:10.039001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: ea2d1d60221d4d98a5baccc7d53db654 May 19 12:36:10.039001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-VolumesNegativeTest-590533151-project May 19 12:36:10.039001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: May 19 12:36:10.039001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Volume 654bf4c1-ab7a-4494-b963-4fff933b94a9 could not be found. May 19 12:36:10.039001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '654bf4c1-ab7a-4494-b963-4fff933b94a9'} May 19 12:36:10.039001 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 654bf4c1-ab7a-4494-b963-4fff933b94a9 could not be found. (HTTP 404) (Request-ID: req-33fd3fb8-a72d-4ee8-98eb-551206f07b34) May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:10.039921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 12:36:10.041266 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 654bf4c1-ab7a-4494-b963-4fff933b94a9 could not be found. May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 12:36:10.043052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 654bf4c1-ab7a-4494-b963-4fff933b94a9 could not be found. May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 654bf4c1-ab7a-4494-b963-4fff933b94a9 could not be found. May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5650aff4-f8d1-4bc4-bce8-2e387e858bc8 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Returning 404 to user: Volume 654bf4c1-ab7a-4494-b963-4fff933b94a9 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5650aff4-f8d1-4bc4-bce8-2e387e858bc8 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/654bf4c1-ab7a-4494-b963-4fff933b94a9" status: 404 len: 109 microversion: 2.1 time: 0.035461 May 19 12:36:10.044586 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 540/1163] 10.222.0.57 () {58 vars in 1247 bytes} [Thu May 19 12:36:10 2022] DELETE /compute/v2.1/os-volumes/654bf4c1-ab7a-4494-b963-4fff933b94a9 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:36:10.048737 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f2044cb2-3265-440d-a924-dd1d4b20e128 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Calling method '.version_select at 0x7fd4555efa60>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:36:10.076613 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-f2044cb2-3265-440d-a924-dd1d4b20e128 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] HTTP exception thrown: Volume b71204b1-8d92-458a-b15f-579c7653a2a3 could not be found. May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f2044cb2-3265-440d-a924-dd1d4b20e128 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Request method failure captured: May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/os-volumes/b71204b1-8d92-458a-b15f-579c7653a2a3 HTTP/1.1 May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjm5y7pQ8uoI4dM-RA0DymDSBPu2ERNPIpjkAuxBBs8yNhJU6IwdgU4Rk9ToRZ0-WkZnUb-8vWU2FSnA11IUdYKOcWWn5cYHVm8e1r1I058AMuFBiTFh-X1FO1VMrvprmS320cB1n44osHEjRi9pYwn-7ZE_lVX0c_P62fL5iK9ybB8 May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: e58d2ae3ee1b45cbac9cbb69bc198031 May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-VolumesNegativeTest-590533151 May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:36:10.078672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:36:10.080518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e58d2ae3ee1b45cbac9cbb69bc198031"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e58d2ae3ee1b45cbac9cbb69bc198031", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:36:10.080518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-VolumesNegativeTest-590533151 May 19 12:36:10.080518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: e58d2ae3ee1b45cbac9cbb69bc198031 May 19 12:36:10.080518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-VolumesNegativeTest-590533151 May 19 12:36:10.080518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-VolumesNegativeTest-590533151-project May 19 12:36:10.080518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:36:10.080518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:36:10.080518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: ea2d1d60221d4d98a5baccc7d53db654 May 19 12:36:10.080518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-VolumesNegativeTest-590533151-project May 19 12:36:10.080518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: May 19 12:36:10.080518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Volume b71204b1-8d92-458a-b15f-579c7653a2a3 could not be found. May 19 12:36:10.080518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': 'b71204b1-8d92-458a-b15f-579c7653a2a3'} May 19 12:36:10.080518 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b71204b1-8d92-458a-b15f-579c7653a2a3 could not be found. (HTTP 404) (Request-ID: req-e9fabfd4-7a99-48a3-af5f-4f9f94660f6e) May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:10.084204 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:36:10.085588 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b71204b1-8d92-458a-b15f-579c7653a2a3 could not be found. May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 12:36:10.086974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b71204b1-8d92-458a-b15f-579c7653a2a3 could not be found. May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b71204b1-8d92-458a-b15f-579c7653a2a3 could not be found. May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f2044cb2-3265-440d-a924-dd1d4b20e128 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] Returning 404 to user: Volume b71204b1-8d92-458a-b15f-579c7653a2a3 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f2044cb2-3265-440d-a924-dd1d4b20e128 tempest-VolumesNegativeTest-590533151 tempest-VolumesNegativeTest-590533151-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/b71204b1-8d92-458a-b15f-579c7653a2a3" status: 404 len: 109 microversion: 2.1 time: 0.035192 May 19 12:36:10.088334 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 624/1164] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:36:10 2022] GET /compute/v2.1/os-volumes/b71204b1-8d92-458a-b15f-579c7653a2a3 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:36:32.902309 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:36:32.907317 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:36:33.089664 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4d6c0c59-6b09-4195-9f7e-e67ee0b7ae89 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Action: 'create', calling method: .version_select at 0x7fd45522baf0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1443882366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqHMfFSUY6JtUFkbbb056NIZqc1MMfplbWSieBRFJIM7Po1gwFJHHhcMPLUx/qa6CSL76CmSOynIzKYY+/1gesxEuQ88w2IcEUIvmUD6hJ/hb/QDQddGRbFZ6s9HZQckg=="}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:36:33.107120 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-4d6c0c59-6b09-4195-9f7e-e67ee0b7ae89 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Getting quotas for project ff5ebee4cf6c47f9adee30f9c8cd6ba1. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:36:33.112067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-4d6c0c59-6b09-4195-9f7e-e67ee0b7ae89 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Getting quotas for user 0beb4f30b5c34ab0afdbfbf46dbfede5 and project ff5ebee4cf6c47f9adee30f9c8cd6ba1. Resources: {'key_pairs'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:36:33.178086 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4d6c0c59-6b09-4195-9f7e-e67ee0b7ae89 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.277124 May 19 12:36:33.178872 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 541/1165] 10.222.0.57 () {60 vars in 1158 bytes} [Thu May 19 12:36:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:36:36.786374 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:36:36.787431 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=30 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:36:37.044482 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c6733ad8-65a1-40f3-bf4e-841129278845 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:36:37.045142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c6733ad8-65a1-40f3-bf4e-841129278845 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:36:37.051157 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c6733ad8-65a1-40f3-bf4e-841129278845 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:37.051611 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c6733ad8-65a1-40f3-bf4e-841129278845 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:37.052374 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c6733ad8-65a1-40f3-bf4e-841129278845 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:37.052813 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c6733ad8-65a1-40f3-bf4e-841129278845 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:37.082273 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c6733ad8-65a1-40f3-bf4e-841129278845 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/ips" status: 200 len: 150 microversion: 2.1 time: 0.297974 May 19 12:36:37.082889 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 625/1166] 10.222.0.57 () {58 vars in 1247 bytes} [Thu May 19 12:36:36 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/ips => generated 150 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:36:39.902695 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-79b0d029-6429-418b-b35e-44cc6e722be7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ee2b1a0-21c6-43b3-b890-b0c188969b6b"}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:36:39.903902 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-79b0d029-6429-418b-b35e-44cc6e722be7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:36:39.911347 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-79b0d029-6429-418b-b35e-44cc6e722be7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:39.912187 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-79b0d029-6429-418b-b35e-44cc6e722be7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:39.913174 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-79b0d029-6429-418b-b35e-44cc6e722be7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:39.913611 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-79b0d029-6429-418b-b35e-44cc6e722be7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:40.884045 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-79b0d029-6429-418b-b35e-44cc6e722be7 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "POST /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.987718 May 19 12:36:40.884668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 542/1167] 10.222.0.57 () {60 vars in 1322 bytes} [Thu May 19 12:36:39 2022] POST /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments => generated 194 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:36:59.032368 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-07b95cdf-1f14-4f58-a839-f84ef9a71852 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:36:59.032878 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-07b95cdf-1f14-4f58-a839-f84ef9a71852 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:36:59.040573 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-07b95cdf-1f14-4f58-a839-f84ef9a71852 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:59.041018 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-07b95cdf-1f14-4f58-a839-f84ef9a71852 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:59.041886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-07b95cdf-1f14-4f58-a839-f84ef9a71852 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:59.042318 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-07b95cdf-1f14-4f58-a839-f84ef9a71852 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:59.125350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-07b95cdf-1f14-4f58-a839-f84ef9a71852 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lazy-loading 'services' on Instance uuid 038dca0d-d260-4c40-a7a9-aca8ea121bf7 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:36:59.283781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-07b95cdf-1f14-4f58-a839-f84ef9a71852 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments/4ee2b1a0-21c6-43b3-b890-b0c188969b6b" status: 202 len: 0 microversion: 2.1 time: 0.255509 May 19 12:36:59.284582 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 626/1168] 10.222.0.57 () {58 vars in 1415 bytes} [Thu May 19 12:36:59 2022] DELETE /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments/4ee2b1a0-21c6-43b3-b890-b0c188969b6b => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:36:59.293696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8ed184ca-fd7b-4a9f-b9ad-2a45c6a4b4d2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:36:59.294795 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8ed184ca-fd7b-4a9f-b9ad-2a45c6a4b4d2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:36:59.297252 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=4 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:36:59.297908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:36:59.298572 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:36:59.304212 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8ed184ca-fd7b-4a9f-b9ad-2a45c6a4b4d2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:59.304661 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8ed184ca-fd7b-4a9f-b9ad-2a45c6a4b4d2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:59.314058 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8ed184ca-fd7b-4a9f-b9ad-2a45c6a4b4d2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:36:59.314058 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8ed184ca-fd7b-4a9f-b9ad-2a45c6a4b4d2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:36:59.337346 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8ed184ca-fd7b-4a9f-b9ad-2a45c6a4b4d2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048115 May 19 12:36:59.337906 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 543/1169] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:36:59 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:37:00.350804 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6f0844ab-f84a-493e-b9e2-f30051ae9674 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:00.351777 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6f0844ab-f84a-493e-b9e2-f30051ae9674 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:00.358120 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6f0844ab-f84a-493e-b9e2-f30051ae9674 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:00.358599 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6f0844ab-f84a-493e-b9e2-f30051ae9674 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:00.359496 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6f0844ab-f84a-493e-b9e2-f30051ae9674 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:00.359927 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6f0844ab-f84a-493e-b9e2-f30051ae9674 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:00.391984 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6f0844ab-f84a-493e-b9e2-f30051ae9674 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046448 May 19 12:37:00.392537 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 627/1170] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:37:00 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:37:01.405186 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-db906819-3f8b-4aa5-a917-d4f675452346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:01.406051 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-db906819-3f8b-4aa5-a917-d4f675452346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:01.413505 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-db906819-3f8b-4aa5-a917-d4f675452346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:01.413970 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-db906819-3f8b-4aa5-a917-d4f675452346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:01.414800 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-db906819-3f8b-4aa5-a917-d4f675452346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:01.415234 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-db906819-3f8b-4aa5-a917-d4f675452346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:01.444723 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-db906819-3f8b-4aa5-a917-d4f675452346 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044454 May 19 12:37:01.445275 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 544/1171] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:37:01 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:37:02.456658 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f0143ea6-a5d5-450d-a1c8-fbc38831d747 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:02.458052 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f0143ea6-a5d5-450d-a1c8-fbc38831d747 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:02.464724 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f0143ea6-a5d5-450d-a1c8-fbc38831d747 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:02.465175 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f0143ea6-a5d5-450d-a1c8-fbc38831d747 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:02.465953 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f0143ea6-a5d5-450d-a1c8-fbc38831d747 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:02.466387 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f0143ea6-a5d5-450d-a1c8-fbc38831d747 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:02.497209 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f0143ea6-a5d5-450d-a1c8-fbc38831d747 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044533 May 19 12:37:02.497772 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 628/1172] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:37:02 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:37:03.515534 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0e7723d2-8e3a-4037-8f29-5baf815a6031 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:03.516459 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0e7723d2-8e3a-4037-8f29-5baf815a6031 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:03.523802 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0e7723d2-8e3a-4037-8f29-5baf815a6031 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:03.524248 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0e7723d2-8e3a-4037-8f29-5baf815a6031 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:03.525006 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0e7723d2-8e3a-4037-8f29-5baf815a6031 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:03.525440 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0e7723d2-8e3a-4037-8f29-5baf815a6031 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:03.557595 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0e7723d2-8e3a-4037-8f29-5baf815a6031 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046566 May 19 12:37:03.558183 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 545/1173] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:37:03 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:37:04.569268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b741340f-d97e-4b32-8c93-0122bf02f5f0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:04.570189 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b741340f-d97e-4b32-8c93-0122bf02f5f0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:04.576664 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b741340f-d97e-4b32-8c93-0122bf02f5f0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:04.577111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b741340f-d97e-4b32-8c93-0122bf02f5f0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:04.577883 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b741340f-d97e-4b32-8c93-0122bf02f5f0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:04.578305 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b741340f-d97e-4b32-8c93-0122bf02f5f0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:04.607754 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b741340f-d97e-4b32-8c93-0122bf02f5f0 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042549 May 19 12:37:04.608312 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 629/1174] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:37:04 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:37:05.620581 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6f87750d-969e-48f7-abda-d3ad5d404f0f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:05.621553 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6f87750d-969e-48f7-abda-d3ad5d404f0f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:05.628256 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f87750d-969e-48f7-abda-d3ad5d404f0f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:05.628691 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f87750d-969e-48f7-abda-d3ad5d404f0f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:05.629447 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f87750d-969e-48f7-abda-d3ad5d404f0f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:05.629943 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6f87750d-969e-48f7-abda-d3ad5d404f0f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:05.658435 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6f87750d-969e-48f7-abda-d3ad5d404f0f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042301 May 19 12:37:05.662461 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 546/1175] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:37:05 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:37:06.670856 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3353903b-5ab0-4e20-a7d7-b8ccf3f9f8c3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:06.671783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3353903b-5ab0-4e20-a7d7-b8ccf3f9f8c3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:06.679036 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3353903b-5ab0-4e20-a7d7-b8ccf3f9f8c3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:06.679766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3353903b-5ab0-4e20-a7d7-b8ccf3f9f8c3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:06.680229 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3353903b-5ab0-4e20-a7d7-b8ccf3f9f8c3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:06.680917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3353903b-5ab0-4e20-a7d7-b8ccf3f9f8c3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:06.710726 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3353903b-5ab0-4e20-a7d7-b8ccf3f9f8c3 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043806 May 19 12:37:06.711292 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 630/1176] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:37:06 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:37:07.721243 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-79a2e227-27e4-4a6c-86ed-a1092aaafb9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:07.722187 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-79a2e227-27e4-4a6c-86ed-a1092aaafb9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:07.729684 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-79a2e227-27e4-4a6c-86ed-a1092aaafb9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:07.729684 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-79a2e227-27e4-4a6c-86ed-a1092aaafb9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:07.730086 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-79a2e227-27e4-4a6c-86ed-a1092aaafb9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:07.730543 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-79a2e227-27e4-4a6c-86ed-a1092aaafb9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:07.760310 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-79a2e227-27e4-4a6c-86ed-a1092aaafb9c tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042986 May 19 12:37:07.760876 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 547/1177] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:37:07 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:37:08.779368 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e9ed7dd5-1c49-4bcd-88fd-66e3e5d2aebd tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:08.780306 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e9ed7dd5-1c49-4bcd-88fd-66e3e5d2aebd tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:08.787222 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e9ed7dd5-1c49-4bcd-88fd-66e3e5d2aebd tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:08.787678 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e9ed7dd5-1c49-4bcd-88fd-66e3e5d2aebd tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:08.788719 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e9ed7dd5-1c49-4bcd-88fd-66e3e5d2aebd tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:08.789160 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e9ed7dd5-1c49-4bcd-88fd-66e3e5d2aebd tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:08.826833 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e9ed7dd5-1c49-4bcd-88fd-66e3e5d2aebd tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050951 May 19 12:37:08.827399 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 631/1178] 10.222.0.57 () {58 vars in 1301 bytes} [Thu May 19 12:37:08 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 12:37:08.893331 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ccd98b8f-93e9-48ab-be30-82f1abb3e59e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:08.893331 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ccd98b8f-93e9-48ab-be30-82f1abb3e59e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:08.898944 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ccd98b8f-93e9-48ab-be30-82f1abb3e59e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:08.899702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ccd98b8f-93e9-48ab-be30-82f1abb3e59e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:08.900566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ccd98b8f-93e9-48ab-be30-82f1abb3e59e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:08.901142 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ccd98b8f-93e9-48ab-be30-82f1abb3e59e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:08.929876 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ccd98b8f-93e9-48ab-be30-82f1abb3e59e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:37:09.227450 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ccd98b8f-93e9-48ab-be30-82f1abb3e59e tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 204 len: 0 microversion: 2.1 time: 0.341436 May 19 12:37:09.228420 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 548/1179] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:37:08 2022] DELETE /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:37:09.236547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6ead6e03-a9a2-4c1b-92ef-cd9f66fc9336 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:09.239473 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6ead6e03-a9a2-4c1b-92ef-cd9f66fc9336 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:09.244536 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6ead6e03-a9a2-4c1b-92ef-cd9f66fc9336 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:09.244982 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6ead6e03-a9a2-4c1b-92ef-cd9f66fc9336 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:09.245738 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6ead6e03-a9a2-4c1b-92ef-cd9f66fc9336 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:09.246168 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6ead6e03-a9a2-4c1b-92ef-cd9f66fc9336 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:09.385825 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6ead6e03-a9a2-4c1b-92ef-cd9f66fc9336 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:09.393395 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6ead6e03-a9a2-4c1b-92ef-cd9f66fc9336 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1681 microversion: 2.1 time: 0.160745 May 19 12:37:09.393976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 632/1180] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:09 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:10.411458 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2f4029fe-5d91-4aba-9452-a239cce122ea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:10.412158 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2f4029fe-5d91-4aba-9452-a239cce122ea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:10.418700 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2f4029fe-5d91-4aba-9452-a239cce122ea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:10.419148 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2f4029fe-5d91-4aba-9452-a239cce122ea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:10.419907 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2f4029fe-5d91-4aba-9452-a239cce122ea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:10.420343 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2f4029fe-5d91-4aba-9452-a239cce122ea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:10.554229 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2f4029fe-5d91-4aba-9452-a239cce122ea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:10.562163 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2f4029fe-5d91-4aba-9452-a239cce122ea tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1681 microversion: 2.1 time: 0.154924 May 19 12:37:10.562844 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 549/1181] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:10 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:11.580911 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-17596e6c-9dec-4567-9313-2cd0ebb9f9b2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:11.581509 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-17596e6c-9dec-4567-9313-2cd0ebb9f9b2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:11.588296 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-17596e6c-9dec-4567-9313-2cd0ebb9f9b2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:11.588743 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-17596e6c-9dec-4567-9313-2cd0ebb9f9b2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:11.589516 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-17596e6c-9dec-4567-9313-2cd0ebb9f9b2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:11.590163 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-17596e6c-9dec-4567-9313-2cd0ebb9f9b2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:11.807107 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-17596e6c-9dec-4567-9313-2cd0ebb9f9b2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:11.814886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-17596e6c-9dec-4567-9313-2cd0ebb9f9b2 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1681 microversion: 2.1 time: 0.237839 May 19 12:37:11.816278 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 633/1182] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:11 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1681 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:12.497181 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-519bbf09-0e11-4be5-af6f-6b8f1e666086 req-1b55a70c-2706-45b8-a2fa-43d1f1f7a68d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "038dca0d-d260-4c40-a7a9-aca8ea121bf7", "name": "network-vif-deleted", "tag": "543abcf6-9f44-4c9b-ae1f-bf82ebc9e926"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:37:12.513837 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-519bbf09-0e11-4be5-af6f-6b8f1e666086 req-1b55a70c-2706-45b8-a2fa-43d1f1f7a68d service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:12.514668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-519bbf09-0e11-4be5-af6f-6b8f1e666086 req-1b55a70c-2706-45b8-a2fa-43d1f1f7a68d service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:12.537349 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-519bbf09-0e11-4be5-af6f-6b8f1e666086 req-1b55a70c-2706-45b8-a2fa-43d1f1f7a68d service nova] Creating event network-vif-deleted:543abcf6-9f44-4c9b-ae1f-bf82ebc9e926 for instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 on hv-cinder-77819 May 19 12:37:12.550716 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-519bbf09-0e11-4be5-af6f-6b8f1e666086 req-1b55a70c-2706-45b8-a2fa-43d1f1f7a68d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062304 May 19 12:37:12.552077 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 550/1183] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:37:12.833508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ec6cb023-1879-42a8-9773-f016d84c23c8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:12.834318 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ec6cb023-1879-42a8-9773-f016d84c23c8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:12.840813 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec6cb023-1879-42a8-9773-f016d84c23c8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:12.841266 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec6cb023-1879-42a8-9773-f016d84c23c8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:12.842075 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec6cb023-1879-42a8-9773-f016d84c23c8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:12.842532 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec6cb023-1879-42a8-9773-f016d84c23c8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:12.876250 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec6cb023-1879-42a8-9773-f016d84c23c8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:12.876703 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ec6cb023-1879-42a8-9773-f016d84c23c8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:12.877170 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.objects.instance [None req-ec6cb023-1879-42a8-9773-f016d84c23c8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lazy-loading 'fault' on Instance uuid 038dca0d-d260-4c40-a7a9-aca8ea121bf7 {{(pid=118112) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:37:12.923481 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ec6cb023-1879-42a8-9773-f016d84c23c8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0a98f1c068843a684f6765d41cc4e49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86c353f6ded643e6b501ec57800fafc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:12.936267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ec6cb023-1879-42a8-9773-f016d84c23c8 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 200 len: 1330 microversion: 2.1 time: 0.107213 May 19 12:37:12.937478 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 634/1184] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:12 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:13.956509 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4dab5383-7322-4e59-931a-603acce215ad tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:13.957216 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4dab5383-7322-4e59-931a-603acce215ad tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:13.964590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4dab5383-7322-4e59-931a-603acce215ad tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:13.965044 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4dab5383-7322-4e59-931a-603acce215ad tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:13.965824 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4dab5383-7322-4e59-931a-603acce215ad tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:13.966261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4dab5383-7322-4e59-931a-603acce215ad tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:13.982625 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-4dab5383-7322-4e59-931a-603acce215ad tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4dab5383-7322-4e59-931a-603acce215ad tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 HTTP/1.1 May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:37:13.983122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:37:13.984942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:37:13.984942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:13.984942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:13.984942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:13.984942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:13.984942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:37:13.984942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:37:13.984942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:37:13.984942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:13.984942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:37:13.984942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:13.984942 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '038dca0d-d260-4c40-a7a9-aca8ea121bf7'} May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:13.989441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:13.991321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:13.992492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4dab5383-7322-4e59-931a-603acce215ad tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 404 to user: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:13.992492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4dab5383-7322-4e59-931a-603acce215ad tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 404 len: 111 microversion: 2.1 time: 0.032976 May 19 12:37:13.992492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 551/1185] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:13 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:37:14.000028 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a6f87544-7f63-48d5-b603-9abc423e86cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '.version_select at 0x7fd45574ff70>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:14.183059 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a6f87544-7f63-48d5-b603-9abc423e86cb tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-558420619" status: 202 len: 0 microversion: 2.1 time: 0.187990 May 19 12:37:14.185567 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 635/1186] 10.222.0.57 () {58 vars in 1217 bytes} [Thu May 19 12:37:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-558420619 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:37:20.545766 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4bdd65af-d3d1-4e7c-a9e0-435fef7abc5f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:20.552283 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4bdd65af-d3d1-4e7c-a9e0-435fef7abc5f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:20.553672 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4bdd65af-d3d1-4e7c-a9e0-435fef7abc5f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:20.553815 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4bdd65af-d3d1-4e7c-a9e0-435fef7abc5f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:20.554599 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4bdd65af-d3d1-4e7c-a9e0-435fef7abc5f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:20.555036 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-4bdd65af-d3d1-4e7c-a9e0-435fef7abc5f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:20.569664 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-4bdd65af-d3d1-4e7c-a9e0-435fef7abc5f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4bdd65af-d3d1-4e7c-a9e0-435fef7abc5f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 HTTP/1.1 May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:37:20.571276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:37:20.573054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:37:20.573054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:20.573054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:20.573054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:20.573054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:20.573054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:37:20.573054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:37:20.573054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:37:20.573054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:20.573054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:37:20.573054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:20.573054 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '038dca0d-d260-4c40-a7a9-aca8ea121bf7'} May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:20.573858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:20.577650 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:20.579194 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4bdd65af-d3d1-4e7c-a9e0-435fef7abc5f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 404 to user: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:20.579194 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4bdd65af-d3d1-4e7c-a9e0-435fef7abc5f tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 404 len: 111 microversion: 2.1 time: 0.031010 May 19 12:37:20.579194 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 552/1187] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:37:20 2022] DELETE /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:37:20.581879 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-7bc22a2a-2bcf-4709-b5f6-cb472a21b050 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:20.582512 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-7bc22a2a-2bcf-4709-b5f6-cb472a21b050 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 038dca0d-d260-4c40-a7a9-aca8ea121bf7] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:20.590323 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7bc22a2a-2bcf-4709-b5f6-cb472a21b050 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:20.590814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7bc22a2a-2bcf-4709-b5f6-cb472a21b050 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:20.591575 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7bc22a2a-2bcf-4709-b5f6-cb472a21b050 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:20.592004 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7bc22a2a-2bcf-4709-b5f6-cb472a21b050 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:20.606600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-7bc22a2a-2bcf-4709-b5f6-cb472a21b050 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-7bc22a2a-2bcf-4709-b5f6-cb472a21b050 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 HTTP/1.1 May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:37:20.608356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:37:20.610072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:37:20.610072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:20.610072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:20.610072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:20.610072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:20.610072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:37:20.610072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:37:20.610072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:37:20.610072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:20.610072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:37:20.610072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:20.610072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '038dca0d-d260-4c40-a7a9-aca8ea121bf7'} May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:20.611766 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. May 19 12:37:20.613429 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:20.614823 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-7bc22a2a-2bcf-4709-b5f6-cb472a21b050 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 404 to user: Instance 038dca0d-d260-4c40-a7a9-aca8ea121bf7 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:20.614823 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-7bc22a2a-2bcf-4709-b5f6-cb472a21b050 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7" status: 404 len: 111 microversion: 2.1 time: 0.032912 May 19 12:37:20.614823 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 636/1188] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:20 2022] GET /compute/v2.1/servers/038dca0d-d260-4c40-a7a9-aca8ea121bf7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:37:21.745777 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2043409433", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1443882366", "security_groups": [{"name": "tempest-secgroup-smoke-333795976"}], "block_device_mapping_v2": [{"uuid": "80e06d53-fe33-4edc-9a28-11933cd12d7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d351609-6722-4245-b241-bc1661734268"}]}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:37:21.893142 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] validate_networks() for [('8d351609-6722-4245-b241-bc1661734268', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:37:21.984526 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a3e2f3db-e9ef-499b-a21d-806995444f35 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:21.985107 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a3e2f3db-e9ef-499b-a21d-806995444f35 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:21.991596 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a3e2f3db-e9ef-499b-a21d-806995444f35 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:21.992156 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a3e2f3db-e9ef-499b-a21d-806995444f35 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:21.993007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a3e2f3db-e9ef-499b-a21d-806995444f35 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:21.993507 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a3e2f3db-e9ef-499b-a21d-806995444f35 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:22.007463 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-a3e2f3db-e9ef-499b-a21d-806995444f35 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a3e2f3db-e9ef-499b-a21d-806995444f35 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: DELETE /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 HTTP/1.1 May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:37:22.009020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:37:22.010728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:37:22.010728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:22.010728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:22.010728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:22.010728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:22.010728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:37:22.010728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:37:22.010728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:37:22.010728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:22.010728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:37:22.010728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:37:22.010728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '5bd02616-e81f-4372-89c1-8a9f63588512'} May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:22.011801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:37:22.013416 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.015281 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a3e2f3db-e9ef-499b-a21d-806995444f35 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 404 to user: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:22.015281 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a3e2f3db-e9ef-499b-a21d-806995444f35 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 404 len: 111 microversion: 2.1 time: 0.029890 May 19 12:37:22.015281 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 637/1189] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:37:21 2022] DELETE /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:37:22.022355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-789b4576-9bbc-4840-9e30-232ac2110c1d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:22.022355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-789b4576-9bbc-4840-9e30-232ac2110c1d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 5bd02616-e81f-4372-89c1-8a9f63588512] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:22.027921 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-789b4576-9bbc-4840-9e30-232ac2110c1d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:22.035508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-789b4576-9bbc-4840-9e30-232ac2110c1d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:22.035508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-789b4576-9bbc-4840-9e30-232ac2110c1d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:22.035508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-789b4576-9bbc-4840-9e30-232ac2110c1d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:22.047244 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-789b4576-9bbc-4840-9e30-232ac2110c1d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-789b4576-9bbc-4840-9e30-232ac2110c1d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 HTTP/1.1 May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:37:22.048793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:37:22.050355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:37:22.050355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:22.050355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:22.050355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:22.050355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:22.050355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:37:22.050355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:37:22.050355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:37:22.050355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:22.050355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:37:22.050355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:37:22.050355 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '5bd02616-e81f-4372-89c1-8a9f63588512'} May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:22.051206 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. May 19 12:37:22.052791 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.054148 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-789b4576-9bbc-4840-9e30-232ac2110c1d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 404 to user: Instance 5bd02616-e81f-4372-89c1-8a9f63588512 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:22.054148 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-789b4576-9bbc-4840-9e30-232ac2110c1d tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512" status: 404 len: 111 microversion: 2.1 time: 0.035140 May 19 12:37:22.054148 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 638/1190] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:22 2022] GET /compute/v2.1/servers/5bd02616-e81f-4372-89c1-8a9f63588512 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:37:22.059047 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6d7083a5-f3bb-47de-b02c-1238b7e712fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:22.064327 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6d7083a5-f3bb-47de-b02c-1238b7e712fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:22.065785 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6d7083a5-f3bb-47de-b02c-1238b7e712fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:22.066238 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6d7083a5-f3bb-47de-b02c-1238b7e712fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:22.067052 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6d7083a5-f3bb-47de-b02c-1238b7e712fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:22.067489 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6d7083a5-f3bb-47de-b02c-1238b7e712fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:22.081919 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-6d7083a5-f3bb-47de-b02c-1238b7e712fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6d7083a5-f3bb-47de-b02c-1238b7e712fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: DELETE /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b HTTP/1.1 May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:37:22.083585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:37:22.085747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:37:22.085747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:22.085747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:22.085747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:22.085747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:22.085747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:37:22.085747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:37:22.085747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:37:22.085747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:22.085747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:37:22.085747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:37:22.085747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '121221d9-cf95-4729-9331-c2696a743b0b'} May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:22.086587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:37:22.087780 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.088961 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6d7083a5-f3bb-47de-b02c-1238b7e712fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 404 to user: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:22.088961 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6d7083a5-f3bb-47de-b02c-1238b7e712fc tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 404 len: 111 microversion: 2.1 time: 0.030503 May 19 12:37:22.088961 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 639/1191] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:37:22 2022] DELETE /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:37:22.094749 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4822af90-e56c-463f-9906-74d338fc4511 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:22.095461 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4822af90-e56c-463f-9906-74d338fc4511 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 121221d9-cf95-4729-9331-c2696a743b0b] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:22.101907 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4822af90-e56c-463f-9906-74d338fc4511 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:22.102358 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4822af90-e56c-463f-9906-74d338fc4511 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:22.103172 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4822af90-e56c-463f-9906-74d338fc4511 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:22.103611 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4822af90-e56c-463f-9906-74d338fc4511 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:22.117309 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-4822af90-e56c-463f-9906-74d338fc4511 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4822af90-e56c-463f-9906-74d338fc4511 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b HTTP/1.1 May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:37:22.118892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:37:22.120486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:37:22.120486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:22.120486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:22.120486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:22.120486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:22.120486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:37:22.120486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:37:22.120486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:37:22.120486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:22.120486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:37:22.120486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:37:22.120486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '121221d9-cf95-4729-9331-c2696a743b0b'} May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:22.121896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. May 19 12:37:22.123406 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:22.124775 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4822af90-e56c-463f-9906-74d338fc4511 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 404 to user: Instance 121221d9-cf95-4729-9331-c2696a743b0b could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:22.124775 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4822af90-e56c-463f-9906-74d338fc4511 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b" status: 404 len: 111 microversion: 2.1 time: 0.029343 May 19 12:37:22.124775 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 640/1192] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:22 2022] GET /compute/v2.1/servers/121221d9-cf95-4729-9331-c2696a743b0b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:37:22.407283 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:37:22.407705 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:37:22.408249 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:37:22.408751 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:37:22.409137 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:37:22.419857 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:22.420298 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:22.421087 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:22.421543 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:22.439476 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Getting quotas for project ff5ebee4cf6c47f9adee30f9c8cd6ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:37:22.443941 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Getting quotas for user 0beb4f30b5c34ab0afdbfbf46dbfede5 and project ff5ebee4cf6c47f9adee30f9c8cd6ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:37:22.506531 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:37:22.508627 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80e06d53-fe33-4edc-9a28-11933cd12d7f',volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:37:22.978117 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-94527016-7674-43b8-b14c-b95c0540963c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.236124 May 19 12:37:22.978990 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 553/1193] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:37:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 12:37:22.988977 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2b189cd2-7297-447b-a074-a9f9f60022c3 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:22.989698 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2b189cd2-7297-447b-a074-a9f9f60022c3 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:23.048975 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2b189cd2-7297-447b-a074-a9f9f60022c3 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:23.056629 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2b189cd2-7297-447b-a074-a9f9f60022c3 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1095 microversion: 2.1 time: 0.071571 May 19 12:37:23.057202 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 641/1194] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:22 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:23.390935 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-75cf710f-d52c-4ceb-ae96-29a0b17d195a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:23.391474 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-75cf710f-d52c-4ceb-ae96-29a0b17d195a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:23.397819 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-75cf710f-d52c-4ceb-ae96-29a0b17d195a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:23.403064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-75cf710f-d52c-4ceb-ae96-29a0b17d195a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:23.403064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-75cf710f-d52c-4ceb-ae96-29a0b17d195a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:23.403064 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-75cf710f-d52c-4ceb-ae96-29a0b17d195a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:23.413380 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-75cf710f-d52c-4ceb-ae96-29a0b17d195a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-75cf710f-d52c-4ceb-ae96-29a0b17d195a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: DELETE /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 HTTP/1.1 May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:37:23.415038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:37:23.416725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:37:23.416725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:23.416725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:23.416725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:23.416725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:23.416725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:37:23.416725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:37:23.416725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:37:23.416725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:23.416725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:37:23.416725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:37:23.416725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': '0ba02619-c806-4c69-bef7-857d2fc19405'} May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:23.418521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:37:23.420013 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:37:23.421493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-75cf710f-d52c-4ceb-ae96-29a0b17d195a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 404 to user: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:23.421493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-75cf710f-d52c-4ceb-ae96-29a0b17d195a tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "DELETE /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 404 len: 111 microversion: 2.1 time: 0.029609 May 19 12:37:23.421493 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 554/1195] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:37:23 2022] DELETE /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:37:23.424979 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-949b3a9b-728f-4b65-9bcf-11471b17b831 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:23.425583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-949b3a9b-728f-4b65-9bcf-11471b17b831 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] [instance: 0ba02619-c806-4c69-bef7-857d2fc19405] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:23.433758 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-949b3a9b-728f-4b65-9bcf-11471b17b831 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:23.434208 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-949b3a9b-728f-4b65-9bcf-11471b17b831 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:23.435000 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-949b3a9b-728f-4b65-9bcf-11471b17b831 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:23.435489 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-949b3a9b-728f-4b65-9bcf-11471b17b831 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:23.449884 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-949b3a9b-728f-4b65-9bcf-11471b17b831 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] HTTP exception thrown: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-949b3a9b-728f-4b65-9bcf-11471b17b831 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Request method failure captured: May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 HTTP/1.1 May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjb9mrQpEY1ias9gG5VZynPe4fBanUqEMfdqLZS55LrbkNFojYhQ7FgSa07elsbHlLBzAurfzN4EuuI7YBtro5QvYYhtKMIWv-4Af8R7325Q011UZT04SYdoydSD8dVkqjspIJg6fzAZuVOFL6jL5yIdlTvxx6J7gfHvDrbmUBAggf8 May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:37:23.451448 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:37:23.453142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/86c353f6ded643e6b501ec57800fafc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_86c353f6ded643e6b501ec57800fafc6", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:37:23.453142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:23.453142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 86c353f6ded643e6b501ec57800fafc6 May 19 12:37:23.453142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-856963837 May 19 12:37:23.453142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:23.453142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:37:23.453142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:37:23.453142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: f0a98f1c068843a684f6765d41cc4e49 May 19 12:37:23.453142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-AttachVolumeNegativeTest-856963837-project May 19 12:37:23.453142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:37:23.453142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:37:23.453142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '0ba02619-c806-4c69-bef7-857d2fc19405'} May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:23.454090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. May 19 12:37:23.467260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:23.468719 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-949b3a9b-728f-4b65-9bcf-11471b17b831 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] Returning 404 to user: Instance 0ba02619-c806-4c69-bef7-857d2fc19405 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:23.468719 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-949b3a9b-728f-4b65-9bcf-11471b17b831 tempest-AttachVolumeNegativeTest-856963837 tempest-AttachVolumeNegativeTest-856963837-project] 10.222.0.57 "GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405" status: 404 len: 111 microversion: 2.1 time: 0.031782 May 19 12:37:23.468719 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 642/1196] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:23 2022] GET /compute/v2.1/servers/0ba02619-c806-4c69-bef7-857d2fc19405 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:37:24.074169 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-4362b4a7-04ba-4094-a91e-8aef38b2f9e2 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:24.074819 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-4362b4a7-04ba-4094-a91e-8aef38b2f9e2 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:24.136683 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-4362b4a7-04ba-4094-a91e-8aef38b2f9e2 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:24.143485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-4362b4a7-04ba-4094-a91e-8aef38b2f9e2 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1095 microversion: 2.1 time: 0.073975 May 19 12:37:24.144051 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 555/1197] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:24 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1095 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:25.161099 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-cc5c0f55-d4b1-4c17-9ae3-607e53cead57 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:25.161736 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-cc5c0f55-d4b1-4c17-9ae3-607e53cead57 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:25.172927 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-cc5c0f55-d4b1-4c17-9ae3-607e53cead57 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:25.173403 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-cc5c0f55-d4b1-4c17-9ae3-607e53cead57 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:25.174111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-cc5c0f55-d4b1-4c17-9ae3-607e53cead57 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:25.174590 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-cc5c0f55-d4b1-4c17-9ae3-607e53cead57 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:25.241902 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-cc5c0f55-d4b1-4c17-9ae3-607e53cead57 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:25.250190 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-cc5c0f55-d4b1-4c17-9ae3-607e53cead57 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1193 microversion: 2.1 time: 0.093160 May 19 12:37:25.250811 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 643/1198] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:25 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1193 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:26.276159 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0c669d2d-5c57-4fe5-9e64-ee6b90530027 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:26.276159 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0c669d2d-5c57-4fe5-9e64-ee6b90530027 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:26.276742 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c669d2d-5c57-4fe5-9e64-ee6b90530027 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:26.276939 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c669d2d-5c57-4fe5-9e64-ee6b90530027 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:26.277722 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c669d2d-5c57-4fe5-9e64-ee6b90530027 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:26.278722 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0c669d2d-5c57-4fe5-9e64-ee6b90530027 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:26.403558 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0c669d2d-5c57-4fe5-9e64-ee6b90530027 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:26.411220 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0c669d2d-5c57-4fe5-9e64-ee6b90530027 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1211 microversion: 2.1 time: 0.147485 May 19 12:37:26.411794 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 556/1199] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:26 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1211 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:27.429567 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c5a0be71-96b5-40e0-ade9-eb33e86fe2d0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:27.434263 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c5a0be71-96b5-40e0-ade9-eb33e86fe2d0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:27.444446 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c5a0be71-96b5-40e0-ade9-eb33e86fe2d0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:27.449159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c5a0be71-96b5-40e0-ade9-eb33e86fe2d0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:27.449159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c5a0be71-96b5-40e0-ade9-eb33e86fe2d0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:27.449159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c5a0be71-96b5-40e0-ade9-eb33e86fe2d0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:27.714795 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c5a0be71-96b5-40e0-ade9-eb33e86fe2d0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:27.728353 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c5a0be71-96b5-40e0-ade9-eb33e86fe2d0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1266 microversion: 2.1 time: 0.303199 May 19 12:37:27.739933 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 644/1200] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:27 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:28.747062 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-51607c27-dd45-4033-8ea6-95ae03ce4d0e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:28.748062 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-51607c27-dd45-4033-8ea6-95ae03ce4d0e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:28.756445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51607c27-dd45-4033-8ea6-95ae03ce4d0e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:28.757255 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51607c27-dd45-4033-8ea6-95ae03ce4d0e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:28.758401 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51607c27-dd45-4033-8ea6-95ae03ce4d0e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:28.759081 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-51607c27-dd45-4033-8ea6-95ae03ce4d0e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:28.782854 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-69f8d242-74bf-4405-ad25-bb7d4053b539 req-629b46f1-0762-41c8-8ba7-47d43acf7d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e64393-40c8-4218-b12d-e1fa8c7e9482", "tag": "8d79ff6d-904d-4eda-8249-f1c895c34508"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:37:28.801331 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-69f8d242-74bf-4405-ad25-bb7d4053b539 req-629b46f1-0762-41c8-8ba7-47d43acf7d8f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:28.801759 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-69f8d242-74bf-4405-ad25-bb7d4053b539 req-629b46f1-0762-41c8-8ba7-47d43acf7d8f service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:28.816678 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-69f8d242-74bf-4405-ad25-bb7d4053b539 req-629b46f1-0762-41c8-8ba7-47d43acf7d8f service nova] Creating event network-changed:8d79ff6d-904d-4eda-8249-f1c895c34508 for instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 on hv-cinder-77819 May 19 12:37:28.831807 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-69f8d242-74bf-4405-ad25-bb7d4053b539 req-629b46f1-0762-41c8-8ba7-47d43acf7d8f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053072 May 19 12:37:28.832409 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 645/1201] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:37:29.064883 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-51607c27-dd45-4033-8ea6-95ae03ce4d0e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:29.074244 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-51607c27-dd45-4033-8ea6-95ae03ce4d0e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1266 microversion: 2.1 time: 0.331544 May 19 12:37:29.074790 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 557/1202] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:28 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1266 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:30.091998 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-7cd68da4-ca07-4cc6-b8a4-564ad60328a2 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:30.092681 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-7cd68da4-ca07-4cc6-b8a4-564ad60328a2 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:30.094607 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:30.100209 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7cd68da4-ca07-4cc6-b8a4-564ad60328a2 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:30.100877 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7cd68da4-ca07-4cc6-b8a4-564ad60328a2 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:30.101587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7cd68da4-ca07-4cc6-b8a4-564ad60328a2 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:30.102029 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7cd68da4-ca07-4cc6-b8a4-564ad60328a2 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:30.105084 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:30.249074 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-7cd68da4-ca07-4cc6-b8a4-564ad60328a2 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:30.258140 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-7cd68da4-ca07-4cc6-b8a4-564ad60328a2 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1266 microversion: 2.1 time: 0.170608 May 19 12:37:30.258814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 646/1203] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:30 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:30.566007 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f289dd55-951c-42aa-930f-5cd912e410d8 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] Action: 'create', calling method: .version_select at 0x7fd45a8be310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-47532338", "metadata": {"Type": "work"}}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:37:31.276358 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ad234282-edc2-4512-9f0d-84d2a6ce8883 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:31.277111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ad234282-edc2-4512-9f0d-84d2a6ce8883 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:31.283919 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ad234282-edc2-4512-9f0d-84d2a6ce8883 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:31.284365 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ad234282-edc2-4512-9f0d-84d2a6ce8883 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:31.285141 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ad234282-edc2-4512-9f0d-84d2a6ce8883 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:31.285583 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ad234282-edc2-4512-9f0d-84d2a6ce8883 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:31.367637 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f289dd55-951c-42aa-930f-5cd912e410d8 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.918432 May 19 12:37:31.368298 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 558/1204] 10.222.0.57 () {60 vars in 1155 bytes} [Thu May 19 12:37:30 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 920 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 12:37:31.379340 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3a949696-f6a0-477c-8e0c-a6dda89b5e13 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] Calling method '.version_select at 0x7fd45a8d4d30>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:31.429951 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ad234282-edc2-4512-9f0d-84d2a6ce8883 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:31.434472 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3a949696-f6a0-477c-8e0c-a6dda89b5e13 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/892e7e07-a929-4658-b0e5-3f765c9db14b" status: 200 len: 351 microversion: 2.1 time: 0.058882 May 19 12:37:31.435264 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 559/1205] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:37:31 2022] GET /compute/v2.1/os-volumes/892e7e07-a929-4658-b0e5-3f765c9db14b => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:37:31.438099 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ad234282-edc2-4512-9f0d-84d2a6ce8883 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1266 microversion: 2.1 time: 0.166840 May 19 12:37:31.438707 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 647/1206] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:31 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:32.445613 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:32.450374 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7e9648b2-4b63-48b0-ba5b-42604d77488e tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] Calling method '.version_select at 0x7fd45a90f940>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:32.454802 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9bd8bb10-a71e-4000-8861-e0adbedd9c0f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:32.455415 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9bd8bb10-a71e-4000-8861-e0adbedd9c0f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:32.464944 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9bd8bb10-a71e-4000-8861-e0adbedd9c0f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:32.465391 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9bd8bb10-a71e-4000-8861-e0adbedd9c0f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:32.466175 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9bd8bb10-a71e-4000-8861-e0adbedd9c0f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:32.466635 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9bd8bb10-a71e-4000-8861-e0adbedd9c0f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:32.505510 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7e9648b2-4b63-48b0-ba5b-42604d77488e tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/892e7e07-a929-4658-b0e5-3f765c9db14b" status: 200 len: 352 microversion: 2.1 time: 0.061804 May 19 12:37:32.506156 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 560/1207] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:37:32 2022] GET /compute/v2.1/os-volumes/892e7e07-a929-4658-b0e5-3f765c9db14b => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:37:32.527133 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ffc16e1a-3d4f-4880-b0fb-e39840314f97 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] Calling method '.version_select at 0x7fd45a8bef70>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:32.580932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ffc16e1a-3d4f-4880-b0fb-e39840314f97 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/892e7e07-a929-4658-b0e5-3f765c9db14b" status: 200 len: 352 microversion: 2.1 time: 0.057622 May 19 12:37:32.581603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 561/1208] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:37:32 2022] GET /compute/v2.1/os-volumes/892e7e07-a929-4658-b0e5-3f765c9db14b => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:37:32.599945 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a9ce187d-f496-4ace-bdae-0308f1e2ac69 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] Calling method '.version_select at 0x7fd456b608b0>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:32.625189 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9bd8bb10-a71e-4000-8861-e0adbedd9c0f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:32.633710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9bd8bb10-a71e-4000-8861-e0adbedd9c0f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1266 microversion: 2.1 time: 0.182698 May 19 12:37:32.634377 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 648/1209] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:32 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:37:32.860461 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a9ce187d-f496-4ace-bdae-0308f1e2ac69 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/892e7e07-a929-4658-b0e5-3f765c9db14b" status: 202 len: 0 microversion: 2.1 time: 0.265706 May 19 12:37:32.861213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 562/1210] 10.222.0.57 () {58 vars in 1247 bytes} [Thu May 19 12:37:32 2022] DELETE /compute/v2.1/os-volumes/892e7e07-a929-4658-b0e5-3f765c9db14b => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 12:37:32.869166 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-5e72f87d-eb46-4634-b3ff-5cb97b015c04 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] Calling method '.version_select at 0x7fd4555fa430>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:32.917921 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-5e72f87d-eb46-4634-b3ff-5cb97b015c04 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/892e7e07-a929-4658-b0e5-3f765c9db14b" status: 200 len: 351 microversion: 2.1 time: 0.052535 May 19 12:37:32.918532 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 649/1211] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:37:32 2022] GET /compute/v2.1/os-volumes/892e7e07-a929-4658-b0e5-3f765c9db14b => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:37:33.652867 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9b2d7a97-6eb1-46f2-a31a-2d923d2d2040 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:33.653472 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9b2d7a97-6eb1-46f2-a31a-2d923d2d2040 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:33.655371 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:33.660681 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9b2d7a97-6eb1-46f2-a31a-2d923d2d2040 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:33.661130 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9b2d7a97-6eb1-46f2-a31a-2d923d2d2040 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:33.661894 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9b2d7a97-6eb1-46f2-a31a-2d923d2d2040 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:33.662359 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9b2d7a97-6eb1-46f2-a31a-2d923d2d2040 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:33.804153 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9b2d7a97-6eb1-46f2-a31a-2d923d2d2040 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:33.815195 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9b2d7a97-6eb1-46f2-a31a-2d923d2d2040 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1266 microversion: 2.1 time: 0.167147 May 19 12:37:33.817935 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 563/1212] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:33 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:33.926704 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:33.931654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8667d028-e137-4a51-93db-1549061a0579 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] Calling method '.version_select at 0x7fd4555ef430>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:33.959995 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-8667d028-e137-4a51-93db-1549061a0579 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] HTTP exception thrown: Volume 892e7e07-a929-4658-b0e5-3f765c9db14b could not be found. May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8667d028-e137-4a51-93db-1549061a0579 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] Request method failure captured: May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/os-volumes/892e7e07-a929-4658-b0e5-3f765c9db14b HTTP/1.1 May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjoKV1TKUJ8D26F4ixK9gc0lji2lkJzTX1ozV5v5jAGz5r60H6vaOnZcrzeIsXuo4h6RypP2qlDjI0LAccqqTv1ry96NJD3jzkxWo8oqdAME44MYsOx5WdMesM6ldb-icR1BUUsW9sHS6m0bAQELkIn-XNlRKoVvsSl_BgnNidJwB8I May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: 7d70b80c295040c481bcb2f87147593f May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-VolumesGetTestJSON-506083388 May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:37:33.962667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:37:33.969488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7d70b80c295040c481bcb2f87147593f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/7d70b80c295040c481bcb2f87147593f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/7d70b80c295040c481bcb2f87147593f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_7d70b80c295040c481bcb2f87147593f", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:37:33.969488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-VolumesGetTestJSON-506083388 May 19 12:37:33.969488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: 7d70b80c295040c481bcb2f87147593f May 19 12:37:33.969488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-VolumesGetTestJSON-506083388 May 19 12:37:33.969488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-VolumesGetTestJSON-506083388-project May 19 12:37:33.969488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:37:33.969488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:37:33.969488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 146816f543e342bba35085f0fca83d8f May 19 12:37:33.969488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-VolumesGetTestJSON-506083388-project May 19 12:37:33.969488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: May 19 12:37:33.969488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Volume 892e7e07-a929-4658-b0e5-3f765c9db14b could not be found. May 19 12:37:33.969488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '892e7e07-a929-4658-b0e5-3f765c9db14b'} May 19 12:37:33.969488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 892e7e07-a929-4658-b0e5-3f765c9db14b could not be found. (HTTP 404) (Request-ID: req-17e232cb-c472-47c2-b7e3-8ff197a30d17) May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:33.971007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 12:37:33.972548 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 892e7e07-a929-4658-b0e5-3f765c9db14b could not be found. May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 12:37:33.973976 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 892e7e07-a929-4658-b0e5-3f765c9db14b could not be found. May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 892e7e07-a929-4658-b0e5-3f765c9db14b could not be found. May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-8667d028-e137-4a51-93db-1549061a0579 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] Returning 404 to user: Volume 892e7e07-a929-4658-b0e5-3f765c9db14b could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-8667d028-e137-4a51-93db-1549061a0579 tempest-VolumesGetTestJSON-506083388 tempest-VolumesGetTestJSON-506083388-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/892e7e07-a929-4658-b0e5-3f765c9db14b" status: 404 len: 109 microversion: 2.1 time: 0.038189 May 19 12:37:33.975458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 650/1213] 10.222.0.57 () {58 vars in 1244 bytes} [Thu May 19 12:37:33 2022] GET /compute/v2.1/os-volumes/892e7e07-a929-4658-b0e5-3f765c9db14b => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:37:34.833395 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7323d611-090e-4f2a-90fc-b766bb6151ed tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:34.834301 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7323d611-090e-4f2a-90fc-b766bb6151ed tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:34.838125 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=8 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:34.842900 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7323d611-090e-4f2a-90fc-b766bb6151ed tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:34.843422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7323d611-090e-4f2a-90fc-b766bb6151ed tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:34.844120 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7323d611-090e-4f2a-90fc-b766bb6151ed tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:34.844561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7323d611-090e-4f2a-90fc-b766bb6151ed tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:35.002058 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7323d611-090e-4f2a-90fc-b766bb6151ed tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:35.011279 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7323d611-090e-4f2a-90fc-b766bb6151ed tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1266 microversion: 2.1 time: 0.181525 May 19 12:37:35.011628 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 564/1214] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:34 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:37:36.030276 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a380af3b-4632-4c82-8b82-573349eb24b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:36.031477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a380af3b-4632-4c82-8b82-573349eb24b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:36.037754 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a380af3b-4632-4c82-8b82-573349eb24b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:36.038272 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a380af3b-4632-4c82-8b82-573349eb24b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:36.039009 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a380af3b-4632-4c82-8b82-573349eb24b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:36.039446 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a380af3b-4632-4c82-8b82-573349eb24b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:36.198306 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a380af3b-4632-4c82-8b82-573349eb24b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:36.210764 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a380af3b-4632-4c82-8b82-573349eb24b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1266 microversion: 2.1 time: 0.186415 May 19 12:37:36.211345 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 651/1215] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:36 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:37.229515 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-3c4a37e3-7978-4ca4-9ecb-c8536edd6c89 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:37.230098 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-3c4a37e3-7978-4ca4-9ecb-c8536edd6c89 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:37.236556 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3c4a37e3-7978-4ca4-9ecb-c8536edd6c89 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:37.237002 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3c4a37e3-7978-4ca4-9ecb-c8536edd6c89 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:37.238213 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3c4a37e3-7978-4ca4-9ecb-c8536edd6c89 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:37.238679 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-3c4a37e3-7978-4ca4-9ecb-c8536edd6c89 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:37.241335 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:37:37.383721 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-3c4a37e3-7978-4ca4-9ecb-c8536edd6c89 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:37.398924 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-3c4a37e3-7978-4ca4-9ecb-c8536edd6c89 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1266 microversion: 2.1 time: 0.174211 May 19 12:37:37.400020 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 565/1216] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:37 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:37:38.418680 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-51e8f860-fe7d-4d81-b294-f09260a86a0c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:38.419299 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-51e8f860-fe7d-4d81-b294-f09260a86a0c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:38.426007 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-51e8f860-fe7d-4d81-b294-f09260a86a0c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:38.426350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-51e8f860-fe7d-4d81-b294-f09260a86a0c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:38.427143 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-51e8f860-fe7d-4d81-b294-f09260a86a0c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:38.427574 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-51e8f860-fe7d-4d81-b294-f09260a86a0c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:38.595092 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-51e8f860-fe7d-4d81-b294-f09260a86a0c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:38.602554 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-51e8f860-fe7d-4d81-b294-f09260a86a0c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1266 microversion: 2.1 time: 0.188785 May 19 12:37:38.603137 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 652/1217] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:38 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:38.614346 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:37:38.614567 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Thu May 19 12:37:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:37:39.620265 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-afdbe51a-5bf4-4d81-a52b-4e104ba4764b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:39.621110 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-afdbe51a-5bf4-4d81-a52b-4e104ba4764b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:39.628153 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-afdbe51a-5bf4-4d81-a52b-4e104ba4764b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:39.628525 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-afdbe51a-5bf4-4d81-a52b-4e104ba4764b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:39.629288 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-afdbe51a-5bf4-4d81-a52b-4e104ba4764b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:39.629724 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-afdbe51a-5bf4-4d81-a52b-4e104ba4764b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:39.792403 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-afdbe51a-5bf4-4d81-a52b-4e104ba4764b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:39.798976 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-afdbe51a-5bf4-4d81-a52b-4e104ba4764b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1266 microversion: 2.1 time: 0.183352 May 19 12:37:39.808821 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 566/1218] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:39 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:40.816600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4a0c30bd-f2b0-4bd1-955d-48f0fe97bc15 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:40.817297 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4a0c30bd-f2b0-4bd1-955d-48f0fe97bc15 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:40.825053 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4a0c30bd-f2b0-4bd1-955d-48f0fe97bc15 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:40.825486 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4a0c30bd-f2b0-4bd1-955d-48f0fe97bc15 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:40.826265 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4a0c30bd-f2b0-4bd1-955d-48f0fe97bc15 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:40.826746 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4a0c30bd-f2b0-4bd1-955d-48f0fe97bc15 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:41.332985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4a0c30bd-f2b0-4bd1-955d-48f0fe97bc15 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:41.344793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4a0c30bd-f2b0-4bd1-955d-48f0fe97bc15 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1266 microversion: 2.1 time: 0.532073 May 19 12:37:41.346264 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 653/1219] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:40 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1266 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:41.415512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-fe06eb89-b356-4d00-a4a5-778df54364f7 req-8956fafe-46f1-4f0c-9e15-4583d5840db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e64393-40c8-4218-b12d-e1fa8c7e9482", "name": "network-vif-plugged", "status": "completed", "tag": "8d79ff6d-904d-4eda-8249-f1c895c34508"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:37:41.425876 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-fe06eb89-b356-4d00-a4a5-778df54364f7 req-8956fafe-46f1-4f0c-9e15-4583d5840db6 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:41.426316 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-fe06eb89-b356-4d00-a4a5-778df54364f7 req-8956fafe-46f1-4f0c-9e15-4583d5840db6 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:41.438672 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-fe06eb89-b356-4d00-a4a5-778df54364f7 req-8956fafe-46f1-4f0c-9e15-4583d5840db6 service nova] Creating event network-vif-plugged:8d79ff6d-904d-4eda-8249-f1c895c34508 for instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 on hv-cinder-77819 May 19 12:37:41.443739 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-fe06eb89-b356-4d00-a4a5-778df54364f7 req-8956fafe-46f1-4f0c-9e15-4583d5840db6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188921 May 19 12:37:41.444337 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 567/1220] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:37:42.363425 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c734ed63-6cdd-4a55-a5f5-a2f1e1b28094 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:42.364081 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c734ed63-6cdd-4a55-a5f5-a2f1e1b28094 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:42.371668 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c734ed63-6cdd-4a55-a5f5-a2f1e1b28094 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:42.372116 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c734ed63-6cdd-4a55-a5f5-a2f1e1b28094 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:42.377065 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c734ed63-6cdd-4a55-a5f5-a2f1e1b28094 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:42.377065 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c734ed63-6cdd-4a55-a5f5-a2f1e1b28094 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:42.515177 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c734ed63-6cdd-4a55-a5f5-a2f1e1b28094 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:42.522691 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c734ed63-6cdd-4a55-a5f5-a2f1e1b28094 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1266 microversion: 2.1 time: 0.163099 May 19 12:37:42.528573 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 654/1221] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:42 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:43.540717 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b425f0fe-40ca-4b8e-ba2f-113c3480952a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:43.542141 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b425f0fe-40ca-4b8e-ba2f-113c3480952a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:43.548898 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b425f0fe-40ca-4b8e-ba2f-113c3480952a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:43.549349 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b425f0fe-40ca-4b8e-ba2f-113c3480952a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:43.550125 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b425f0fe-40ca-4b8e-ba2f-113c3480952a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:43.550584 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b425f0fe-40ca-4b8e-ba2f-113c3480952a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:43.707322 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b425f0fe-40ca-4b8e-ba2f-113c3480952a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:43.716087 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b425f0fe-40ca-4b8e-ba2f-113c3480952a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1453 microversion: 2.1 time: 0.179931 May 19 12:37:43.716969 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 568/1222] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:43 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:43.733164 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-97526579-8296-43a0-82d9-0671f1543cf8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:37:43.733776 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-97526579-8296-43a0-82d9-0671f1543cf8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:37:43.740445 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-97526579-8296-43a0-82d9-0671f1543cf8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:43.740888 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-97526579-8296-43a0-82d9-0671f1543cf8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:43.741654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-97526579-8296-43a0-82d9-0671f1543cf8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:43.742090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-97526579-8296-43a0-82d9-0671f1543cf8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:43.877190 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-97526579-8296-43a0-82d9-0671f1543cf8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:37:43.885420 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-97526579-8296-43a0-82d9-0671f1543cf8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1453 microversion: 2.1 time: 0.156325 May 19 12:37:43.886145 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 655/1223] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:37:43 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:37:46.184320 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-6419df18-ece1-4b3a-ac12-0795e718a5bb req-4ec65bde-9ef1-4c05-9313-ced6eb070bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e64393-40c8-4218-b12d-e1fa8c7e9482", "tag": "8d79ff6d-904d-4eda-8249-f1c895c34508"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:37:46.192963 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-6419df18-ece1-4b3a-ac12-0795e718a5bb req-4ec65bde-9ef1-4c05-9313-ced6eb070bf7 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:37:46.193402 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-6419df18-ece1-4b3a-ac12-0795e718a5bb req-4ec65bde-9ef1-4c05-9313-ced6eb070bf7 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:37:46.205435 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-6419df18-ece1-4b3a-ac12-0795e718a5bb req-4ec65bde-9ef1-4c05-9313-ced6eb070bf7 service nova] Creating event network-changed:8d79ff6d-904d-4eda-8249-f1c895c34508 for instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 on hv-cinder-77819 May 19 12:37:46.211096 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-6419df18-ece1-4b3a-ac12-0795e718a5bb req-4ec65bde-9ef1-4c05-9313-ced6eb070bf7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031405 May 19 12:37:46.211892 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 569/1224] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:38:27.590877 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=15 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:38:27.596040 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=47 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:38:27.782534 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d924576f-b4e5-484e-a551-e28aba255305 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Action: 'create', calling method: .version_select at 0x7fd4555cb160>, body: {"keypair": {"name": "tempest-TestShelveInstance-224386898", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3ItrWZZgLuXmldF9btzmXTyxOpwuSlLRgMV/gRFvgtz+s+K8d/F1ZwYn19uBJWE8R+3IcD/2y3QTvSR0ITW5AVHrSl1GfsNe394/eYd50BHgIyd+nEsdWin7Bm7PAf9w=="}} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:38:27.799580 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-d924576f-b4e5-484e-a551-e28aba255305 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Getting quotas for project d3a4bb3cecc4474e85a49a217fa98d9f. Resources: {'key_pairs'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:38:27.803839 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.quota [None req-d924576f-b4e5-484e-a551-e28aba255305 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Getting quotas for user 2273aeca59c04c778683e70665b7efa1 and project d3a4bb3cecc4474e85a49a217fa98d9f. Resources: {'key_pairs'} {{(pid=118112) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:38:27.952654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d924576f-b4e5-484e-a551-e28aba255305 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.375913 May 19 12:38:27.954025 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 656/1225] 10.222.0.57 () {60 vars in 1158 bytes} [Thu May 19 12:38:27 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:38:59.178505 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=13 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:38:59.179260 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=21 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:38:59.183912 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1256809405", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-224386898", "security_groups": [{"name": "tempest-secgroup-smoke-1247501261"}], "networks": [{"uuid": "60b1eb1f-b9ad-481b-be65-2ef8ae6d49f7"}], "block_device_mapping_v2": [{"uuid": "993c7bd2-d10c-422f-9550-a169cc6b4a4d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:38:59.297240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] validate_networks() for [('60b1eb1f-b9ad-481b-be65-2ef8ae6d49f7', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:38:59.679613 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:38:59.680037 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:38:59.680802 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:38:59.681245 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:38:59.681655 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:38:59.690319 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:38:59.690833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:38:59.691856 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:38:59.693464 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:38:59.709356 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Getting quotas for project d3a4bb3cecc4474e85a49a217fa98d9f. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:38:59.713395 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Getting quotas for user 2273aeca59c04c778683e70665b7efa1 and project d3a4bb3cecc4474e85a49a217fa98d9f. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:38:59.775358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:38:59.777597 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='993c7bd2-d10c-422f-9550-a169cc6b4a4d',volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:39:00.180219 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2fd95c0b-fad4-4a6d-a136-289d0d4c1f8e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.004785 May 19 12:39:00.181261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 570/1226] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:38:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:39:00.189191 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=4 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:39:00.189930 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:39:00.195434 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e4c35ebc-872b-421b-86e7-e00df272de04 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:00.195434 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e4c35ebc-872b-421b-86e7-e00df272de04 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:00.255920 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e4c35ebc-872b-421b-86e7-e00df272de04 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:00.262783 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e4c35ebc-872b-421b-86e7-e00df272de04 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1088 microversion: 2.1 time: 0.075307 May 19 12:39:00.264471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 657/1227] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:00 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:39:01.280894 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-fdfa6b3f-957e-47c7-8e40-ba702665ae44 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:01.281546 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-fdfa6b3f-957e-47c7-8e40-ba702665ae44 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:01.299476 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fdfa6b3f-957e-47c7-8e40-ba702665ae44 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:01.299927 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fdfa6b3f-957e-47c7-8e40-ba702665ae44 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:01.301310 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fdfa6b3f-957e-47c7-8e40-ba702665ae44 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:01.301763 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-fdfa6b3f-957e-47c7-8e40-ba702665ae44 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:01.364325 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-fdfa6b3f-957e-47c7-8e40-ba702665ae44 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:01.371982 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-fdfa6b3f-957e-47c7-8e40-ba702665ae44 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1138 microversion: 2.1 time: 0.095465 May 19 12:39:01.372676 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 571/1228] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:01 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1138 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:02.390117 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-30454048-2b6f-4464-be84-73ae7ad1ba23 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:02.390811 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-30454048-2b6f-4464-be84-73ae7ad1ba23 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:02.399023 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-30454048-2b6f-4464-be84-73ae7ad1ba23 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:02.399511 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-30454048-2b6f-4464-be84-73ae7ad1ba23 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:02.400289 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-30454048-2b6f-4464-be84-73ae7ad1ba23 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:02.400741 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-30454048-2b6f-4464-be84-73ae7ad1ba23 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:02.525267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-30454048-2b6f-4464-be84-73ae7ad1ba23 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:02.532969 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-30454048-2b6f-4464-be84-73ae7ad1ba23 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1194 microversion: 2.1 time: 0.146907 May 19 12:39:02.534063 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 658/1229] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:02 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1194 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:39:03.554554 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5f57dc0c-04ce-42cf-85a9-c6ed78abac9e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:03.561823 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5f57dc0c-04ce-42cf-85a9-c6ed78abac9e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:03.580750 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5f57dc0c-04ce-42cf-85a9-c6ed78abac9e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:03.581193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5f57dc0c-04ce-42cf-85a9-c6ed78abac9e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:03.583284 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5f57dc0c-04ce-42cf-85a9-c6ed78abac9e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:03.583968 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5f57dc0c-04ce-42cf-85a9-c6ed78abac9e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:03.798818 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5f57dc0c-04ce-42cf-85a9-c6ed78abac9e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:03.807985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5f57dc0c-04ce-42cf-85a9-c6ed78abac9e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1272 microversion: 2.1 time: 0.260168 May 19 12:39:03.808929 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 572/1230] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:03 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1272 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:04.321247 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-5618ece2-5e1a-4eb4-a2d3-4f5dc1fbaed3 req-2fb83d26-86d5-4802-9b9c-c953946ac4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2beb7602-f905-4c4b-99cb-d09ed934c240", "tag": "773e254a-2926-43ce-b4b2-88eca458ded1"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:39:04.332777 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-5618ece2-5e1a-4eb4-a2d3-4f5dc1fbaed3 req-2fb83d26-86d5-4802-9b9c-c953946ac4ac service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:04.332777 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-5618ece2-5e1a-4eb4-a2d3-4f5dc1fbaed3 req-2fb83d26-86d5-4802-9b9c-c953946ac4ac service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:04.348312 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-5618ece2-5e1a-4eb4-a2d3-4f5dc1fbaed3 req-2fb83d26-86d5-4802-9b9c-c953946ac4ac service nova] Creating event network-changed:773e254a-2926-43ce-b4b2-88eca458ded1 for instance 2beb7602-f905-4c4b-99cb-d09ed934c240 on hv-cinder-77819 May 19 12:39:04.354130 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-5618ece2-5e1a-4eb4-a2d3-4f5dc1fbaed3 req-2fb83d26-86d5-4802-9b9c-c953946ac4ac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036302 May 19 12:39:04.355181 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 659/1231] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:39:04.829195 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b94e2699-7ad0-4caa-8a5d-dc55fd04a227 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:04.829799 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b94e2699-7ad0-4caa-8a5d-dc55fd04a227 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:04.836774 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b94e2699-7ad0-4caa-8a5d-dc55fd04a227 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:04.837221 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b94e2699-7ad0-4caa-8a5d-dc55fd04a227 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:04.837998 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b94e2699-7ad0-4caa-8a5d-dc55fd04a227 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:04.838452 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b94e2699-7ad0-4caa-8a5d-dc55fd04a227 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:05.216147 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b94e2699-7ad0-4caa-8a5d-dc55fd04a227 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:05.224339 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b94e2699-7ad0-4caa-8a5d-dc55fd04a227 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1260 microversion: 2.1 time: 0.399021 May 19 12:39:05.224947 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 573/1232] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:04 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1260 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:06.243299 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e62abf14-ecf4-4737-9d47-ffcc300df0e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:06.244345 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e62abf14-ecf4-4737-9d47-ffcc300df0e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:06.252452 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e62abf14-ecf4-4737-9d47-ffcc300df0e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:06.252897 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e62abf14-ecf4-4737-9d47-ffcc300df0e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:06.253741 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e62abf14-ecf4-4737-9d47-ffcc300df0e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:06.254178 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e62abf14-ecf4-4737-9d47-ffcc300df0e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:06.403853 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e62abf14-ecf4-4737-9d47-ffcc300df0e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:06.412180 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e62abf14-ecf4-4737-9d47-ffcc300df0e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1260 microversion: 2.1 time: 0.174486 May 19 12:39:06.412747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 660/1233] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:06 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:07.428878 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c5fb2ef8-ae56-4e06-9fb3-dd9751c955f9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:07.429485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c5fb2ef8-ae56-4e06-9fb3-dd9751c955f9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:07.436193 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c5fb2ef8-ae56-4e06-9fb3-dd9751c955f9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:07.436637 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c5fb2ef8-ae56-4e06-9fb3-dd9751c955f9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:07.437401 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c5fb2ef8-ae56-4e06-9fb3-dd9751c955f9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:07.437835 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c5fb2ef8-ae56-4e06-9fb3-dd9751c955f9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:07.580492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c5fb2ef8-ae56-4e06-9fb3-dd9751c955f9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:07.589254 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c5fb2ef8-ae56-4e06-9fb3-dd9751c955f9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1260 microversion: 2.1 time: 0.164198 May 19 12:39:07.589921 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 574/1234] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:07 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:08.606998 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-d0f9357e-ffe3-49cd-8f7b-2f725a10816a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:08.607642 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-d0f9357e-ffe3-49cd-8f7b-2f725a10816a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:08.614798 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d0f9357e-ffe3-49cd-8f7b-2f725a10816a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:08.615258 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d0f9357e-ffe3-49cd-8f7b-2f725a10816a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:08.616034 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d0f9357e-ffe3-49cd-8f7b-2f725a10816a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:08.616467 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-d0f9357e-ffe3-49cd-8f7b-2f725a10816a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:08.751907 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-d0f9357e-ffe3-49cd-8f7b-2f725a10816a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:08.759942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-d0f9357e-ffe3-49cd-8f7b-2f725a10816a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1260 microversion: 2.1 time: 0.157067 May 19 12:39:08.760508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 661/1235] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:08 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:09.778261 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b6a51b02-ad2a-4473-a5f4-74d6a5ea80b9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:09.778893 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-b6a51b02-ad2a-4473-a5f4-74d6a5ea80b9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:09.781160 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:39:09.781839 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:39:09.787168 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b6a51b02-ad2a-4473-a5f4-74d6a5ea80b9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:09.788210 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b6a51b02-ad2a-4473-a5f4-74d6a5ea80b9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:09.788994 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b6a51b02-ad2a-4473-a5f4-74d6a5ea80b9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:09.789420 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-b6a51b02-ad2a-4473-a5f4-74d6a5ea80b9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:09.933886 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-b6a51b02-ad2a-4473-a5f4-74d6a5ea80b9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:09.942072 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b6a51b02-ad2a-4473-a5f4-74d6a5ea80b9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1260 microversion: 2.1 time: 0.167604 May 19 12:39:09.942696 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 575/1236] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:09 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:10.960647 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6ab020ed-f193-481c-8cfd-e38ceafa5b14 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:10.961252 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6ab020ed-f193-481c-8cfd-e38ceafa5b14 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:10.963710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:39:10.968608 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6ab020ed-f193-481c-8cfd-e38ceafa5b14 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:10.973864 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6ab020ed-f193-481c-8cfd-e38ceafa5b14 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:10.973864 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6ab020ed-f193-481c-8cfd-e38ceafa5b14 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:10.973864 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6ab020ed-f193-481c-8cfd-e38ceafa5b14 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:11.104024 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6ab020ed-f193-481c-8cfd-e38ceafa5b14 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:11.111842 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6ab020ed-f193-481c-8cfd-e38ceafa5b14 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1260 microversion: 2.1 time: 0.155423 May 19 12:39:11.116980 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 662/1237] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:10 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:12.128773 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a92229e4-44da-4d02-9e62-22b4c88510b1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:12.129430 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a92229e4-44da-4d02-9e62-22b4c88510b1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:12.135981 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a92229e4-44da-4d02-9e62-22b4c88510b1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:12.136435 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a92229e4-44da-4d02-9e62-22b4c88510b1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:12.137205 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a92229e4-44da-4d02-9e62-22b4c88510b1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:12.137639 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a92229e4-44da-4d02-9e62-22b4c88510b1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:12.268918 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a92229e4-44da-4d02-9e62-22b4c88510b1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:12.277095 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a92229e4-44da-4d02-9e62-22b4c88510b1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1260 microversion: 2.1 time: 0.152134 May 19 12:39:12.277630 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 576/1238] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:12 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:13.293671 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3d90557a-9036-4fca-8cd6-742992a58343 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:13.294267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3d90557a-9036-4fca-8cd6-742992a58343 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:13.300733 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3d90557a-9036-4fca-8cd6-742992a58343 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:13.301173 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3d90557a-9036-4fca-8cd6-742992a58343 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:13.301929 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3d90557a-9036-4fca-8cd6-742992a58343 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:13.302360 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3d90557a-9036-4fca-8cd6-742992a58343 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:13.440123 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3d90557a-9036-4fca-8cd6-742992a58343 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:13.447978 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3d90557a-9036-4fca-8cd6-742992a58343 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1260 microversion: 2.1 time: 0.158168 May 19 12:39:13.448777 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 663/1239] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:13 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:14.465758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-24871b3d-3428-4077-ace3-03c3eefda0ea tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:14.466359 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-24871b3d-3428-4077-ace3-03c3eefda0ea tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:14.472759 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-24871b3d-3428-4077-ace3-03c3eefda0ea tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:14.473202 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-24871b3d-3428-4077-ace3-03c3eefda0ea tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:14.473992 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-24871b3d-3428-4077-ace3-03c3eefda0ea tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:14.474484 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-24871b3d-3428-4077-ace3-03c3eefda0ea tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:14.607051 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-24871b3d-3428-4077-ace3-03c3eefda0ea tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:14.614510 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-24871b3d-3428-4077-ace3-03c3eefda0ea tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1260 microversion: 2.1 time: 0.152564 May 19 12:39:14.615085 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 577/1240] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:14 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:39:15.632191 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b8088b1f-37a6-41bd-bea1-307c4eaa0365 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:15.633609 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b8088b1f-37a6-41bd-bea1-307c4eaa0365 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:15.639444 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b8088b1f-37a6-41bd-bea1-307c4eaa0365 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:15.639886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b8088b1f-37a6-41bd-bea1-307c4eaa0365 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:15.640659 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b8088b1f-37a6-41bd-bea1-307c4eaa0365 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:15.641097 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b8088b1f-37a6-41bd-bea1-307c4eaa0365 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:15.748580 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-ad10ae2f-ecb3-4ca4-b9e3-0b750ded61e8 req-ac07513a-bad5-4718-a3ad-08e3c5a91b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2beb7602-f905-4c4b-99cb-d09ed934c240", "name": "network-vif-plugged", "status": "completed", "tag": "773e254a-2926-43ce-b4b2-88eca458ded1"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:39:15.760798 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ad10ae2f-ecb3-4ca4-b9e3-0b750ded61e8 req-ac07513a-bad5-4718-a3ad-08e3c5a91b0a service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:15.761247 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-ad10ae2f-ecb3-4ca4-b9e3-0b750ded61e8 req-ac07513a-bad5-4718-a3ad-08e3c5a91b0a service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:15.773042 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-ad10ae2f-ecb3-4ca4-b9e3-0b750ded61e8 req-ac07513a-bad5-4718-a3ad-08e3c5a91b0a service nova] Creating event network-vif-plugged:773e254a-2926-43ce-b4b2-88eca458ded1 for instance 2beb7602-f905-4c4b-99cb-d09ed934c240 on hv-cinder-77819 May 19 12:39:15.778761 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-ad10ae2f-ecb3-4ca4-b9e3-0b750ded61e8 req-ac07513a-bad5-4718-a3ad-08e3c5a91b0a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035177 May 19 12:39:15.784855 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 578/1241] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:39:15.785150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b8088b1f-37a6-41bd-bea1-307c4eaa0365 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:15.792210 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b8088b1f-37a6-41bd-bea1-307c4eaa0365 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1260 microversion: 2.1 time: 0.164194 May 19 12:39:15.792650 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 664/1242] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:15 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:16.810691 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8fc59f6c-dc16-4c5f-91ea-fcbeda86cf37 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:16.811376 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8fc59f6c-dc16-4c5f-91ea-fcbeda86cf37 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:16.817587 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8fc59f6c-dc16-4c5f-91ea-fcbeda86cf37 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:16.818053 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8fc59f6c-dc16-4c5f-91ea-fcbeda86cf37 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:16.818896 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8fc59f6c-dc16-4c5f-91ea-fcbeda86cf37 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:16.819971 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8fc59f6c-dc16-4c5f-91ea-fcbeda86cf37 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:16.950643 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8fc59f6c-dc16-4c5f-91ea-fcbeda86cf37 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:16.958052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8fc59f6c-dc16-4c5f-91ea-fcbeda86cf37 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1260 microversion: 2.1 time: 0.152427 May 19 12:39:16.958711 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 579/1243] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:16 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:17.509985 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:39:17.510268 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Thu May 19 12:39:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:39:17.976673 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-af9b1319-4032-4ee7-ab44-ecb669a2be1a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:17.977262 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-af9b1319-4032-4ee7-ab44-ecb669a2be1a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:17.983966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-af9b1319-4032-4ee7-ab44-ecb669a2be1a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:17.984405 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-af9b1319-4032-4ee7-ab44-ecb669a2be1a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:17.985205 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-af9b1319-4032-4ee7-ab44-ecb669a2be1a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:17.985635 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-af9b1319-4032-4ee7-ab44-ecb669a2be1a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:18.290338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-af9b1319-4032-4ee7-ab44-ecb669a2be1a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:18.298163 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-af9b1319-4032-4ee7-ab44-ecb669a2be1a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1260 microversion: 2.1 time: 0.326154 May 19 12:39:18.298787 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 665/1244] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:17 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1260 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:19.315251 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d1682761-b443-49cc-92c7-19be4cd2d5eb tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:19.315779 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d1682761-b443-49cc-92c7-19be4cd2d5eb tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:19.323166 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d1682761-b443-49cc-92c7-19be4cd2d5eb tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:19.323616 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d1682761-b443-49cc-92c7-19be4cd2d5eb tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:19.324382 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d1682761-b443-49cc-92c7-19be4cd2d5eb tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:19.324816 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d1682761-b443-49cc-92c7-19be4cd2d5eb tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:19.511514 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d1682761-b443-49cc-92c7-19be4cd2d5eb tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:19.519676 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d1682761-b443-49cc-92c7-19be4cd2d5eb tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1444 microversion: 2.1 time: 0.208314 May 19 12:39:19.520248 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 580/1245] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:19 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1444 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:19.536773 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-19d4533a-b028-4210-9fb8-694c6c2836de tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:39:19.537415 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-19d4533a-b028-4210-9fb8-694c6c2836de tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:39:19.544072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-19d4533a-b028-4210-9fb8-694c6c2836de tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:19.544526 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-19d4533a-b028-4210-9fb8-694c6c2836de tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:19.545300 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-19d4533a-b028-4210-9fb8-694c6c2836de tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:19.545772 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-19d4533a-b028-4210-9fb8-694c6c2836de tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:19.680441 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-19d4533a-b028-4210-9fb8-694c6c2836de tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:39:19.688415 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-19d4533a-b028-4210-9fb8-694c6c2836de tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1444 microversion: 2.1 time: 0.155459 May 19 12:39:19.688989 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 666/1246] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:39:19 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:39:22.240180 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-68bac94a-5b60-4899-8648-347037f6c2a9 req-476cb087-040b-4e0e-94d8-0fac9f00d83e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2beb7602-f905-4c4b-99cb-d09ed934c240", "tag": "773e254a-2926-43ce-b4b2-88eca458ded1"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:39:22.249009 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-68bac94a-5b60-4899-8648-347037f6c2a9 req-476cb087-040b-4e0e-94d8-0fac9f00d83e service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:39:22.249700 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-68bac94a-5b60-4899-8648-347037f6c2a9 req-476cb087-040b-4e0e-94d8-0fac9f00d83e service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:39:22.261198 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-68bac94a-5b60-4899-8648-347037f6c2a9 req-476cb087-040b-4e0e-94d8-0fac9f00d83e service nova] Creating event network-changed:773e254a-2926-43ce-b4b2-88eca458ded1 for instance 2beb7602-f905-4c4b-99cb-d09ed934c240 on hv-cinder-77819 May 19 12:39:22.266475 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-68bac94a-5b60-4899-8648-347037f6c2a9 req-476cb087-040b-4e0e-94d8-0fac9f00d83e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030027 May 19 12:39:22.267076 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 581/1247] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:40:03.961822 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-44a13490-64ca-4a4e-ac47-436bf705fa37 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:03.962477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-44a13490-64ca-4a4e-ac47-436bf705fa37 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:03.964380 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=22 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:03.965027 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=50 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:03.969801 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-44a13490-64ca-4a4e-ac47-436bf705fa37 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:03.970247 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-44a13490-64ca-4a4e-ac47-436bf705fa37 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:03.971400 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-44a13490-64ca-4a4e-ac47-436bf705fa37 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:03.971669 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-44a13490-64ca-4a4e-ac47-436bf705fa37 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:03.995982 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-44a13490-64ca-4a4e-ac47-436bf705fa37 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Going to try to terminate instance {{(pid=118112) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:40:04.336555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-44a13490-64ca-4a4e-ac47-436bf705fa37 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 204 len: 0 microversion: 2.1 time: 0.378450 May 19 12:40:04.337150 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 667/1248] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:40:03 2022] DELETE /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:40:04.343364 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:04.345399 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=60 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:04.348992 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ae1a4e1a-5b98-437e-9cfd-8787c72d7f10 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:04.349700 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ae1a4e1a-5b98-437e-9cfd-8787c72d7f10 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:04.355795 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ae1a4e1a-5b98-437e-9cfd-8787c72d7f10 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:04.356243 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ae1a4e1a-5b98-437e-9cfd-8787c72d7f10 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:04.357110 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ae1a4e1a-5b98-437e-9cfd-8787c72d7f10 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:04.357569 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ae1a4e1a-5b98-437e-9cfd-8787c72d7f10 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:04.490691 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ae1a4e1a-5b98-437e-9cfd-8787c72d7f10 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:04.498152 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ae1a4e1a-5b98-437e-9cfd-8787c72d7f10 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1578 microversion: 2.1 time: 0.156562 May 19 12:40:04.498758 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 582/1249] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:04 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:05.516490 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-b0b5ff7c-7642-4796-a5da-c3b5e99f1a81 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:05.517188 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-b0b5ff7c-7642-4796-a5da-c3b5e99f1a81 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:05.524481 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b0b5ff7c-7642-4796-a5da-c3b5e99f1a81 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:05.524933 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b0b5ff7c-7642-4796-a5da-c3b5e99f1a81 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:05.525691 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b0b5ff7c-7642-4796-a5da-c3b5e99f1a81 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:05.526127 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-b0b5ff7c-7642-4796-a5da-c3b5e99f1a81 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:05.664565 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-b0b5ff7c-7642-4796-a5da-c3b5e99f1a81 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:05.671948 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-b0b5ff7c-7642-4796-a5da-c3b5e99f1a81 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1578 microversion: 2.1 time: 0.159648 May 19 12:40:05.672507 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 668/1250] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:05 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:06.729328 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-97294be4-c1a6-4949-97c8-bc928b9e3c5c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:06.729328 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-97294be4-c1a6-4949-97c8-bc928b9e3c5c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:06.729328 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-97294be4-c1a6-4949-97c8-bc928b9e3c5c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:06.729328 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-97294be4-c1a6-4949-97c8-bc928b9e3c5c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:06.730073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-97294be4-c1a6-4949-97c8-bc928b9e3c5c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:06.730073 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-97294be4-c1a6-4949-97c8-bc928b9e3c5c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:06.791501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-97294be4-c1a6-4949-97c8-bc928b9e3c5c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:06.802491 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-97294be4-c1a6-4949-97c8-bc928b9e3c5c tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1511 microversion: 2.1 time: 0.113869 May 19 12:40:06.802491 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 583/1251] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:06 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1511 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:06.966074 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-d03844ff-5ecf-48e5-bde1-248d2e1e1f9f req-58004268-6c86-4dcb-a510-216c33922ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e64393-40c8-4218-b12d-e1fa8c7e9482", "name": "network-vif-deleted", "tag": "8d79ff6d-904d-4eda-8249-f1c895c34508"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:40:06.975314 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-d03844ff-5ecf-48e5-bde1-248d2e1e1f9f req-58004268-6c86-4dcb-a510-216c33922ae3 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:06.975769 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-d03844ff-5ecf-48e5-bde1-248d2e1e1f9f req-58004268-6c86-4dcb-a510-216c33922ae3 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:06.991975 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-d03844ff-5ecf-48e5-bde1-248d2e1e1f9f req-58004268-6c86-4dcb-a510-216c33922ae3 service nova] Creating event network-vif-deleted:8d79ff6d-904d-4eda-8249-f1c895c34508 for instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 on hv-cinder-77819 May 19 12:40:06.997061 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-d03844ff-5ecf-48e5-bde1-248d2e1e1f9f req-58004268-6c86-4dcb-a510-216c33922ae3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034604 May 19 12:40:06.998076 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 669/1252] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:40:07.816582 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-00090d2f-8457-4c92-8e76-a7f2eb895bf5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:07.817190 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-00090d2f-8457-4c92-8e76-a7f2eb895bf5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:07.823795 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00090d2f-8457-4c92-8e76-a7f2eb895bf5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:07.824245 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00090d2f-8457-4c92-8e76-a7f2eb895bf5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:07.825005 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00090d2f-8457-4c92-8e76-a7f2eb895bf5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:07.825492 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00090d2f-8457-4c92-8e76-a7f2eb895bf5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:07.859157 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00090d2f-8457-4c92-8e76-a7f2eb895bf5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:07.859605 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-00090d2f-8457-4c92-8e76-a7f2eb895bf5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:07.860065 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-00090d2f-8457-4c92-8e76-a7f2eb895bf5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lazy-loading 'fault' on Instance uuid e5e64393-40c8-4218-b12d-e1fa8c7e9482 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:40:07.906176 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-00090d2f-8457-4c92-8e76-a7f2eb895bf5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:07.914659 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-00090d2f-8457-4c92-8e76-a7f2eb895bf5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 200 len: 1231 microversion: 2.1 time: 0.101999 May 19 12:40:07.915246 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 584/1253] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:07 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:08.933006 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2b88076b-2ddd-4df1-b589-e6d5d80d6d90 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:08.933670 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2b88076b-2ddd-4df1-b589-e6d5d80d6d90 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:08.940155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b88076b-2ddd-4df1-b589-e6d5d80d6d90 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:08.940598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b88076b-2ddd-4df1-b589-e6d5d80d6d90 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:08.941351 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b88076b-2ddd-4df1-b589-e6d5d80d6d90 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:08.941781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b88076b-2ddd-4df1-b589-e6d5d80d6d90 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:08.954487 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-2b88076b-2ddd-4df1-b589-e6d5d80d6d90 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] HTTP exception thrown: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2b88076b-2ddd-4df1-b589-e6d5d80d6d90 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Request method failure captured: May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 HTTP/1.1 May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjnIirHHZnrIqYsfsMtw9qDq7FQL0M8hN3eW2vaiUdExaVdwTuZ-haez21XavKiiPBmAyore_ws4OU8-aWtx3tIa4sc8o2KxAEokq1oYeS6zAkfV2Ymdn-TL-3raZ22DE9IXsbbcJ3mjlzZHvEUxdxcJzc5VPfzPcLHdUbUcM4GpM48 May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: ff5ebee4cf6c47f9adee30f9c8cd6ba1 May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-TestVolumeBootPattern-1730930557 May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:40:08.956082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:40:08.957892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ff5ebee4cf6c47f9adee30f9c8cd6ba1", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:40:08.957892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-TestVolumeBootPattern-1730930557 May 19 12:40:08.957892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: ff5ebee4cf6c47f9adee30f9c8cd6ba1 May 19 12:40:08.957892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-TestVolumeBootPattern-1730930557 May 19 12:40:08.957892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-TestVolumeBootPattern-1730930557-project May 19 12:40:08.957892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:40:08.957892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:40:08.957892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 0beb4f30b5c34ab0afdbfbf46dbfede5 May 19 12:40:08.957892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-TestVolumeBootPattern-1730930557-project May 19 12:40:08.957892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:40:08.957892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:40:08.957892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': 'e5e64393-40c8-4218-b12d-e1fa8c7e9482'} May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:40:08.958917 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:40:08.960625 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:40:08.962104 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2b88076b-2ddd-4df1-b589-e6d5d80d6d90 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Returning 404 to user: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:40:08.962104 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2b88076b-2ddd-4df1-b589-e6d5d80d6d90 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 404 len: 111 microversion: 2.1 time: 0.029433 May 19 12:40:08.962104 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 670/1254] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:08 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:40:09.056351 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-689373821", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1443882366", "security_groups": [{"name": "tempest-secgroup-smoke-333795976"}], "block_device_mapping_v2": [{"uuid": "80e06d53-fe33-4edc-9a28-11933cd12d7f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d351609-6722-4245-b241-bc1661734268"}]}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:40:09.166600 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] validate_networks() for [('8d351609-6722-4245-b241-bc1661734268', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:40:09.530688 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:40:09.531122 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:40:09.531599 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:40:09.532041 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:40:09.532456 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:40:09.542188 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:09.542666 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:09.543454 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:09.543889 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:09.560377 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Getting quotas for project ff5ebee4cf6c47f9adee30f9c8cd6ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:40:09.564754 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Getting quotas for user 0beb4f30b5c34ab0afdbfbf46dbfede5 and project ff5ebee4cf6c47f9adee30f9c8cd6ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:40:09.622898 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:40:09.624994 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80e06d53-fe33-4edc-9a28-11933cd12d7f',volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:40:10.003375 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c215faca-6bee-43dc-bd66-e990c26ecd21 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.952077 May 19 12:40:10.004052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 585/1255] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:40:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:40:10.014194 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6ebae070-4a57-4c25-bb78-e6abf9a51b30 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:10.014910 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6ebae070-4a57-4c25-bb78-e6abf9a51b30 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:10.071935 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6ebae070-4a57-4c25-bb78-e6abf9a51b30 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:10.079218 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6ebae070-4a57-4c25-bb78-e6abf9a51b30 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1094 microversion: 2.1 time: 0.068903 May 19 12:40:10.079767 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 671/1256] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:10 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:11.097426 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a54d97f6-6214-4b2b-8582-907cd7387076 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:11.097990 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a54d97f6-6214-4b2b-8582-907cd7387076 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:11.104340 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a54d97f6-6214-4b2b-8582-907cd7387076 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:11.104803 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a54d97f6-6214-4b2b-8582-907cd7387076 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:11.105574 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a54d97f6-6214-4b2b-8582-907cd7387076 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:11.106016 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a54d97f6-6214-4b2b-8582-907cd7387076 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:11.170935 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a54d97f6-6214-4b2b-8582-907cd7387076 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:11.178519 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a54d97f6-6214-4b2b-8582-907cd7387076 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1144 microversion: 2.1 time: 0.086315 May 19 12:40:11.179110 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 586/1257] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:11 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:12.202741 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6c2d6308-fa9f-4c5a-90de-a8f1d8049223 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:12.203381 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6c2d6308-fa9f-4c5a-90de-a8f1d8049223 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:12.210484 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c2d6308-fa9f-4c5a-90de-a8f1d8049223 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:12.210942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c2d6308-fa9f-4c5a-90de-a8f1d8049223 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:12.211720 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c2d6308-fa9f-4c5a-90de-a8f1d8049223 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:12.212162 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c2d6308-fa9f-4c5a-90de-a8f1d8049223 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:12.290384 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6c2d6308-fa9f-4c5a-90de-a8f1d8049223 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:12.297978 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6c2d6308-fa9f-4c5a-90de-a8f1d8049223 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1210 microversion: 2.1 time: 0.099154 May 19 12:40:12.298585 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 672/1258] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:12 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:13.316485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-551c2b9a-4313-47f7-b0d2-03c794029fe0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:13.317206 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-551c2b9a-4313-47f7-b0d2-03c794029fe0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:13.323881 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-551c2b9a-4313-47f7-b0d2-03c794029fe0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:13.324324 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-551c2b9a-4313-47f7-b0d2-03c794029fe0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:13.325077 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-551c2b9a-4313-47f7-b0d2-03c794029fe0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:13.325504 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-551c2b9a-4313-47f7-b0d2-03c794029fe0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:13.530467 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-551c2b9a-4313-47f7-b0d2-03c794029fe0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:13.538770 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-551c2b9a-4313-47f7-b0d2-03c794029fe0 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1277 microversion: 2.1 time: 0.226614 May 19 12:40:13.539341 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 587/1259] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:13 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:13.975811 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-97a96890-547b-4da3-9eb9-7fe96525f841 req-96ddead4-c97f-455e-843b-aac485539fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1656f0a-ef14-4881-ac85-33d7ee6aa9ef", "tag": "5ec83d31-72fc-40a7-abb0-4d6e27ee9f49"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:40:13.984500 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-97a96890-547b-4da3-9eb9-7fe96525f841 req-96ddead4-c97f-455e-843b-aac485539fe7 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:13.984944 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-97a96890-547b-4da3-9eb9-7fe96525f841 req-96ddead4-c97f-455e-843b-aac485539fe7 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:13.997138 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-97a96890-547b-4da3-9eb9-7fe96525f841 req-96ddead4-c97f-455e-843b-aac485539fe7 service nova] Creating event network-changed:5ec83d31-72fc-40a7-abb0-4d6e27ee9f49 for instance f1656f0a-ef14-4881-ac85-33d7ee6aa9ef on hv-cinder-77819 May 19 12:40:14.002998 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-97a96890-547b-4da3-9eb9-7fe96525f841 req-96ddead4-c97f-455e-843b-aac485539fe7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031268 May 19 12:40:14.003963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 673/1260] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:40:14.555966 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-cc052412-b71f-41a6-a716-821013d04ea6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:14.556498 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-cc052412-b71f-41a6-a716-821013d04ea6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:14.562973 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc052412-b71f-41a6-a716-821013d04ea6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:14.563428 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc052412-b71f-41a6-a716-821013d04ea6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:14.564197 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc052412-b71f-41a6-a716-821013d04ea6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:14.564694 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-cc052412-b71f-41a6-a716-821013d04ea6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:14.770739 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-cc052412-b71f-41a6-a716-821013d04ea6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:14.778313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-cc052412-b71f-41a6-a716-821013d04ea6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1265 microversion: 2.1 time: 0.226553 May 19 12:40:14.778927 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 588/1261] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:14 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:15.796578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c8037f5b-a3a9-46ce-8779-a6ffb6fdf0ee tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:15.797282 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c8037f5b-a3a9-46ce-8779-a6ffb6fdf0ee tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:15.803712 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c8037f5b-a3a9-46ce-8779-a6ffb6fdf0ee tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:15.804177 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c8037f5b-a3a9-46ce-8779-a6ffb6fdf0ee tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:15.804942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c8037f5b-a3a9-46ce-8779-a6ffb6fdf0ee tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:15.805387 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c8037f5b-a3a9-46ce-8779-a6ffb6fdf0ee tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:15.933936 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c8037f5b-a3a9-46ce-8779-a6ffb6fdf0ee tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:15.941875 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c8037f5b-a3a9-46ce-8779-a6ffb6fdf0ee tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1265 microversion: 2.1 time: 0.149993 May 19 12:40:15.942465 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 674/1262] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:15 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:16.958654 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e67e0fab-5e00-473e-8a61-601c01e8d6a1 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:16.959275 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e67e0fab-5e00-473e-8a61-601c01e8d6a1 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:16.965983 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e67e0fab-5e00-473e-8a61-601c01e8d6a1 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:16.966459 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e67e0fab-5e00-473e-8a61-601c01e8d6a1 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:16.967223 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e67e0fab-5e00-473e-8a61-601c01e8d6a1 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:16.967658 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e67e0fab-5e00-473e-8a61-601c01e8d6a1 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:17.098711 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e67e0fab-5e00-473e-8a61-601c01e8d6a1 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:17.106524 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e67e0fab-5e00-473e-8a61-601c01e8d6a1 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1265 microversion: 2.1 time: 0.151694 May 19 12:40:17.107175 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 589/1263] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:16 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:18.124009 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-3576d08b-25a1-4d63-9ab3-0cac63ffe607 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:18.124616 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-3576d08b-25a1-4d63-9ab3-0cac63ffe607 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:18.131698 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3576d08b-25a1-4d63-9ab3-0cac63ffe607 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:18.132141 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3576d08b-25a1-4d63-9ab3-0cac63ffe607 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:18.132893 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3576d08b-25a1-4d63-9ab3-0cac63ffe607 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:18.133323 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-3576d08b-25a1-4d63-9ab3-0cac63ffe607 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:18.264266 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-3576d08b-25a1-4d63-9ab3-0cac63ffe607 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:18.272032 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-3576d08b-25a1-4d63-9ab3-0cac63ffe607 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1265 microversion: 2.1 time: 0.151850 May 19 12:40:18.272597 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 675/1264] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:18 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:19.288622 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-103aaa07-1ce0-47c1-a7b3-0a17f58c72dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:19.289182 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-103aaa07-1ce0-47c1-a7b3-0a17f58c72dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:19.295656 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-103aaa07-1ce0-47c1-a7b3-0a17f58c72dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:19.296101 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-103aaa07-1ce0-47c1-a7b3-0a17f58c72dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:19.296847 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-103aaa07-1ce0-47c1-a7b3-0a17f58c72dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:19.297277 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-103aaa07-1ce0-47c1-a7b3-0a17f58c72dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:19.427847 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-103aaa07-1ce0-47c1-a7b3-0a17f58c72dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:19.435501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-103aaa07-1ce0-47c1-a7b3-0a17f58c72dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1265 microversion: 2.1 time: 0.151451 May 19 12:40:19.436057 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 590/1265] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:19 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:20.451941 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-25d6f5f6-fef1-4506-9475-1daf01f52093 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:20.452539 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-25d6f5f6-fef1-4506-9475-1daf01f52093 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:20.454969 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=2 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:20.460274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25d6f5f6-fef1-4506-9475-1daf01f52093 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:20.460734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25d6f5f6-fef1-4506-9475-1daf01f52093 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:20.468882 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25d6f5f6-fef1-4506-9475-1daf01f52093 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:20.468882 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25d6f5f6-fef1-4506-9475-1daf01f52093 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:20.598267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-25d6f5f6-fef1-4506-9475-1daf01f52093 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:20.605781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-25d6f5f6-fef1-4506-9475-1daf01f52093 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1265 microversion: 2.1 time: 0.157608 May 19 12:40:20.606367 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 676/1266] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:20 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:21.623303 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-192cadd8-61fe-4098-bedf-beef6ea8a48f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:21.623914 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-192cadd8-61fe-4098-bedf-beef6ea8a48f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:21.625848 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:21.626583 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=6 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:40:21.632248 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-192cadd8-61fe-4098-bedf-beef6ea8a48f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:21.632858 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-192cadd8-61fe-4098-bedf-beef6ea8a48f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:21.633743 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-192cadd8-61fe-4098-bedf-beef6ea8a48f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:21.634208 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-192cadd8-61fe-4098-bedf-beef6ea8a48f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:21.835345 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-192cadd8-61fe-4098-bedf-beef6ea8a48f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:21.843594 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-192cadd8-61fe-4098-bedf-beef6ea8a48f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1265 microversion: 2.1 time: 0.224847 May 19 12:40:21.844171 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 591/1267] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:21 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:22.860726 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c7902cc0-a226-42e4-8208-2d9de82acc2f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:22.861356 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c7902cc0-a226-42e4-8208-2d9de82acc2f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:22.868615 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c7902cc0-a226-42e4-8208-2d9de82acc2f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:22.872310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c7902cc0-a226-42e4-8208-2d9de82acc2f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:22.872310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c7902cc0-a226-42e4-8208-2d9de82acc2f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:22.872310 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c7902cc0-a226-42e4-8208-2d9de82acc2f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:23.003279 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c7902cc0-a226-42e4-8208-2d9de82acc2f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:23.011190 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c7902cc0-a226-42e4-8208-2d9de82acc2f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1265 microversion: 2.1 time: 0.154185 May 19 12:40:23.011698 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 677/1268] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:22 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:24.028067 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e16608db-cf0d-430b-bc39-20d4d1c23d52 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:24.030513 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e16608db-cf0d-430b-bc39-20d4d1c23d52 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:24.036848 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e16608db-cf0d-430b-bc39-20d4d1c23d52 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:24.037343 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e16608db-cf0d-430b-bc39-20d4d1c23d52 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:24.038104 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e16608db-cf0d-430b-bc39-20d4d1c23d52 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:24.038563 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e16608db-cf0d-430b-bc39-20d4d1c23d52 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:24.167934 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e16608db-cf0d-430b-bc39-20d4d1c23d52 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:24.175799 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e16608db-cf0d-430b-bc39-20d4d1c23d52 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1265 microversion: 2.1 time: 0.151604 May 19 12:40:24.176385 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 592/1269] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:24 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:25.192873 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4e4da50b-74bb-4a78-ae5a-0da9537b3e44 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:25.193662 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4e4da50b-74bb-4a78-ae5a-0da9537b3e44 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:25.200327 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4e4da50b-74bb-4a78-ae5a-0da9537b3e44 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:25.200781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4e4da50b-74bb-4a78-ae5a-0da9537b3e44 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:25.201542 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4e4da50b-74bb-4a78-ae5a-0da9537b3e44 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:25.201988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4e4da50b-74bb-4a78-ae5a-0da9537b3e44 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:25.333876 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-4e4da50b-74bb-4a78-ae5a-0da9537b3e44 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:25.344673 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4e4da50b-74bb-4a78-ae5a-0da9537b3e44 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1265 microversion: 2.1 time: 0.155407 May 19 12:40:25.345727 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 678/1270] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:25 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:26.096485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-343d097d-8679-4d6f-ad05-787b0d44596e req-65ccfa08-5f2a-4a42-8b64-f75ec0f619f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1656f0a-ef14-4881-ac85-33d7ee6aa9ef", "name": "network-vif-plugged", "status": "completed", "tag": "5ec83d31-72fc-40a7-abb0-4d6e27ee9f49"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:40:26.105198 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-343d097d-8679-4d6f-ad05-787b0d44596e req-65ccfa08-5f2a-4a42-8b64-f75ec0f619f4 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:26.105638 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-343d097d-8679-4d6f-ad05-787b0d44596e req-65ccfa08-5f2a-4a42-8b64-f75ec0f619f4 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:26.119175 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-343d097d-8679-4d6f-ad05-787b0d44596e req-65ccfa08-5f2a-4a42-8b64-f75ec0f619f4 service nova] Creating event network-vif-plugged:5ec83d31-72fc-40a7-abb0-4d6e27ee9f49 for instance f1656f0a-ef14-4881-ac85-33d7ee6aa9ef on hv-cinder-77819 May 19 12:40:26.124153 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-343d097d-8679-4d6f-ad05-787b0d44596e req-65ccfa08-5f2a-4a42-8b64-f75ec0f619f4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032105 May 19 12:40:26.124729 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 593/1271] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:40:26.361966 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-53e04481-9948-4556-b6d6-db3fd6e33286 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:26.362623 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-53e04481-9948-4556-b6d6-db3fd6e33286 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:26.369042 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53e04481-9948-4556-b6d6-db3fd6e33286 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:26.375001 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53e04481-9948-4556-b6d6-db3fd6e33286 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:26.375001 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53e04481-9948-4556-b6d6-db3fd6e33286 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:26.375001 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-53e04481-9948-4556-b6d6-db3fd6e33286 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:26.566121 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-53e04481-9948-4556-b6d6-db3fd6e33286 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:26.573675 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-53e04481-9948-4556-b6d6-db3fd6e33286 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1265 microversion: 2.1 time: 0.215584 May 19 12:40:26.574274 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 679/1272] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:26 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:27.594119 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-32e85737-6747-4751-a1df-7ffcebcedc6b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:27.594910 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-32e85737-6747-4751-a1df-7ffcebcedc6b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:27.605223 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-32e85737-6747-4751-a1df-7ffcebcedc6b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:27.606011 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-32e85737-6747-4751-a1df-7ffcebcedc6b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:27.607474 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-32e85737-6747-4751-a1df-7ffcebcedc6b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:27.608121 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-32e85737-6747-4751-a1df-7ffcebcedc6b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:27.744272 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-32e85737-6747-4751-a1df-7ffcebcedc6b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:27.752039 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-32e85737-6747-4751-a1df-7ffcebcedc6b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1265 microversion: 2.1 time: 0.163152 May 19 12:40:27.752608 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 594/1273] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:27 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:28.768952 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f163ca04-e547-4e8e-b168-6d8ca677427b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:28.769660 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f163ca04-e547-4e8e-b168-6d8ca677427b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:28.775886 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f163ca04-e547-4e8e-b168-6d8ca677427b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:28.776335 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f163ca04-e547-4e8e-b168-6d8ca677427b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:28.777097 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f163ca04-e547-4e8e-b168-6d8ca677427b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:28.777535 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f163ca04-e547-4e8e-b168-6d8ca677427b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:28.907410 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f163ca04-e547-4e8e-b168-6d8ca677427b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:28.915455 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f163ca04-e547-4e8e-b168-6d8ca677427b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1453 microversion: 2.1 time: 0.150545 May 19 12:40:28.916020 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 680/1274] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:28 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:28.932037 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f4d882e9-5984-4e75-8963-54a91526de75 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:40:28.932656 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f4d882e9-5984-4e75-8963-54a91526de75 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:40:28.939170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f4d882e9-5984-4e75-8963-54a91526de75 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:28.939622 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f4d882e9-5984-4e75-8963-54a91526de75 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:28.940386 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f4d882e9-5984-4e75-8963-54a91526de75 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:28.941167 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f4d882e9-5984-4e75-8963-54a91526de75 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:29.075979 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f4d882e9-5984-4e75-8963-54a91526de75 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:40:29.083543 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f4d882e9-5984-4e75-8963-54a91526de75 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1453 microversion: 2.1 time: 0.155627 May 19 12:40:29.084111 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 595/1275] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:40:28 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:40:31.229261 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-e0e288e8-58e5-454d-91b0-72cb0ebef26a req-dc45a662-11c7-4d5a-b9a5-2f01f0163565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1656f0a-ef14-4881-ac85-33d7ee6aa9ef", "tag": "5ec83d31-72fc-40a7-abb0-4d6e27ee9f49"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:40:31.237102 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-e0e288e8-58e5-454d-91b0-72cb0ebef26a req-dc45a662-11c7-4d5a-b9a5-2f01f0163565 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:40:31.237755 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-e0e288e8-58e5-454d-91b0-72cb0ebef26a req-dc45a662-11c7-4d5a-b9a5-2f01f0163565 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:40:31.248676 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-e0e288e8-58e5-454d-91b0-72cb0ebef26a req-dc45a662-11c7-4d5a-b9a5-2f01f0163565 service nova] Creating event network-changed:5ec83d31-72fc-40a7-abb0-4d6e27ee9f49 for instance f1656f0a-ef14-4881-ac85-33d7ee6aa9ef on hv-cinder-77819 May 19 12:40:31.254175 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-e0e288e8-58e5-454d-91b0-72cb0ebef26a req-dc45a662-11c7-4d5a-b9a5-2f01f0163565 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153730 May 19 12:40:31.254798 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 681/1276] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:40:58.624549 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:40:58.625287 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Thu May 19 12:40:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:41:36.106334 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:36.107140 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=78 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:36.111136 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-22873215-aa67-449c-a866-359be2b874e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:41:36.111664 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-22873215-aa67-449c-a866-359be2b874e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:36.117506 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22873215-aa67-449c-a866-359be2b874e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:36.122809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22873215-aa67-449c-a866-359be2b874e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:36.122809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22873215-aa67-449c-a866-359be2b874e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:36.122809 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-22873215-aa67-449c-a866-359be2b874e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:36.141651 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-22873215-aa67-449c-a866-359be2b874e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lazy-loading 'flavor' on Instance uuid 2beb7602-f905-4c4b-99cb-d09ed934c240 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:41:36.413211 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-22873215-aa67-449c-a866-359be2b874e2 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "POST /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240/action" status: 202 len: 0 microversion: 2.1 time: 0.308372 May 19 12:41:36.413825 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 596/1277] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:41:36 2022] POST /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:41:36.420241 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:36.427798 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:41:36.427798 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6c5b1128-6d64-49e6-8121-670ad252329a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:36.427798 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6c5b1128-6d64-49e6-8121-670ad252329a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:36.433312 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c5b1128-6d64-49e6-8121-670ad252329a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:36.433772 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c5b1128-6d64-49e6-8121-670ad252329a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:36.434547 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c5b1128-6d64-49e6-8121-670ad252329a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:36.434986 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6c5b1128-6d64-49e6-8121-670ad252329a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:36.572576 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6c5b1128-6d64-49e6-8121-670ad252329a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:36.579940 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6c5b1128-6d64-49e6-8121-670ad252329a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1569 microversion: 2.1 time: 0.161746 May 19 12:41:36.580502 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 682/1278] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:36 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:37.599037 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-eb93d8ee-3ee3-477f-9d0b-04ac3bd53519 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:37.599792 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-eb93d8ee-3ee3-477f-9d0b-04ac3bd53519 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:37.606629 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eb93d8ee-3ee3-477f-9d0b-04ac3bd53519 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:37.607075 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eb93d8ee-3ee3-477f-9d0b-04ac3bd53519 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:37.607826 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eb93d8ee-3ee3-477f-9d0b-04ac3bd53519 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:37.608254 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eb93d8ee-3ee3-477f-9d0b-04ac3bd53519 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:37.743007 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-eb93d8ee-3ee3-477f-9d0b-04ac3bd53519 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:37.750524 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-eb93d8ee-3ee3-477f-9d0b-04ac3bd53519 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1569 microversion: 2.1 time: 0.156583 May 19 12:41:37.751083 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 597/1279] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:37 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:38.768492 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-31e57d42-2d46-4a03-9f89-a85f9bca0dee tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:38.769180 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-31e57d42-2d46-4a03-9f89-a85f9bca0dee tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:38.775923 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-31e57d42-2d46-4a03-9f89-a85f9bca0dee tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:38.776370 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-31e57d42-2d46-4a03-9f89-a85f9bca0dee tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:38.777133 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-31e57d42-2d46-4a03-9f89-a85f9bca0dee tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:38.777569 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-31e57d42-2d46-4a03-9f89-a85f9bca0dee tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:38.907225 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-31e57d42-2d46-4a03-9f89-a85f9bca0dee tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:38.915293 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-31e57d42-2d46-4a03-9f89-a85f9bca0dee tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1569 microversion: 2.1 time: 0.151118 May 19 12:41:38.915870 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 683/1280] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:38 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:39.932932 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-ef025519-3848-4586-8915-222cee9bf78b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:39.933485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-ef025519-3848-4586-8915-222cee9bf78b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:39.939979 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ef025519-3848-4586-8915-222cee9bf78b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:39.940447 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ef025519-3848-4586-8915-222cee9bf78b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:39.941241 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ef025519-3848-4586-8915-222cee9bf78b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:39.941675 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-ef025519-3848-4586-8915-222cee9bf78b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:40.326945 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-ef025519-3848-4586-8915-222cee9bf78b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:40.334976 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-ef025519-3848-4586-8915-222cee9bf78b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1569 microversion: 2.1 time: 0.406285 May 19 12:41:40.335539 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 598/1281] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:39 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1569 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:41.352232 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2c65877a-45a1-42e8-98c5-c91d7f6cc56c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:41.352787 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2c65877a-45a1-42e8-98c5-c91d7f6cc56c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:41.359313 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2c65877a-45a1-42e8-98c5-c91d7f6cc56c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:41.359770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2c65877a-45a1-42e8-98c5-c91d7f6cc56c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:41.360531 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2c65877a-45a1-42e8-98c5-c91d7f6cc56c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:41.360965 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2c65877a-45a1-42e8-98c5-c91d7f6cc56c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:41.492586 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2c65877a-45a1-42e8-98c5-c91d7f6cc56c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:41.499963 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2c65877a-45a1-42e8-98c5-c91d7f6cc56c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1569 microversion: 2.1 time: 0.151657 May 19 12:41:41.504489 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 684/1282] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:41 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:42.519993 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-9c034e6a-852e-49fc-b03b-eb310f820bb9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:42.520602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-9c034e6a-852e-49fc-b03b-eb310f820bb9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:42.527114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9c034e6a-852e-49fc-b03b-eb310f820bb9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:42.527606 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9c034e6a-852e-49fc-b03b-eb310f820bb9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:42.528358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9c034e6a-852e-49fc-b03b-eb310f820bb9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:42.528785 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-9c034e6a-852e-49fc-b03b-eb310f820bb9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:42.665957 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-9c034e6a-852e-49fc-b03b-eb310f820bb9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:42.673531 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-9c034e6a-852e-49fc-b03b-eb310f820bb9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1569 microversion: 2.1 time: 0.158100 May 19 12:41:42.674098 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 599/1283] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:42 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:43.691304 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-34891838-7503-40a1-82f3-bd36659eb65f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:43.691908 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-34891838-7503-40a1-82f3-bd36659eb65f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:43.698293 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-34891838-7503-40a1-82f3-bd36659eb65f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:43.698770 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-34891838-7503-40a1-82f3-bd36659eb65f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:43.699529 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-34891838-7503-40a1-82f3-bd36659eb65f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:43.699962 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-34891838-7503-40a1-82f3-bd36659eb65f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:43.831399 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-34891838-7503-40a1-82f3-bd36659eb65f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:43.839175 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-34891838-7503-40a1-82f3-bd36659eb65f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1569 microversion: 2.1 time: 0.152196 May 19 12:41:43.839745 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 685/1284] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:43 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:44.856532 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a3bc2c19-d25e-4d53-9b08-9d2d25278fd9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:44.857110 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a3bc2c19-d25e-4d53-9b08-9d2d25278fd9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:44.863585 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3bc2c19-d25e-4d53-9b08-9d2d25278fd9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:44.864025 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3bc2c19-d25e-4d53-9b08-9d2d25278fd9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:44.864783 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3bc2c19-d25e-4d53-9b08-9d2d25278fd9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:44.865223 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a3bc2c19-d25e-4d53-9b08-9d2d25278fd9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:44.992906 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a3bc2c19-d25e-4d53-9b08-9d2d25278fd9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:45.000355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a3bc2c19-d25e-4d53-9b08-9d2d25278fd9 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1569 microversion: 2.1 time: 0.147779 May 19 12:41:45.000922 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 600/1285] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:44 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:46.017549 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-e2ff7fae-8766-469a-8741-bafd66a43934 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:46.018262 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-e2ff7fae-8766-469a-8741-bafd66a43934 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:46.024967 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e2ff7fae-8766-469a-8741-bafd66a43934 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:46.025460 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e2ff7fae-8766-469a-8741-bafd66a43934 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:46.026230 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e2ff7fae-8766-469a-8741-bafd66a43934 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:46.026689 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-e2ff7fae-8766-469a-8741-bafd66a43934 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:46.164077 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-e2ff7fae-8766-469a-8741-bafd66a43934 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:46.171665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-e2ff7fae-8766-469a-8741-bafd66a43934 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1569 microversion: 2.1 time: 0.158066 May 19 12:41:46.172231 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 686/1286] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:46 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:47.188885 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-01972a49-2bc0-4e2f-b798-996c51412743 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:47.189495 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-01972a49-2bc0-4e2f-b798-996c51412743 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:47.196816 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-01972a49-2bc0-4e2f-b798-996c51412743 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:47.197269 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-01972a49-2bc0-4e2f-b798-996c51412743 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:47.198026 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-01972a49-2bc0-4e2f-b798-996c51412743 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:47.198485 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-01972a49-2bc0-4e2f-b798-996c51412743 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:47.329501 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-01972a49-2bc0-4e2f-b798-996c51412743 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:47.337875 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-01972a49-2bc0-4e2f-b798-996c51412743 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1569 microversion: 2.1 time: 0.152795 May 19 12:41:47.338747 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 601/1287] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:47 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:48.354495 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fd2590e3-635d-4a4a-8482-1e185dcb29bf tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:48.355039 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fd2590e3-635d-4a4a-8482-1e185dcb29bf tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:48.361542 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd2590e3-635d-4a4a-8482-1e185dcb29bf tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:48.361983 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd2590e3-635d-4a4a-8482-1e185dcb29bf tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:48.363335 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd2590e3-635d-4a4a-8482-1e185dcb29bf tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:48.363768 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fd2590e3-635d-4a4a-8482-1e185dcb29bf tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:48.499988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fd2590e3-635d-4a4a-8482-1e185dcb29bf tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:48.508097 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fd2590e3-635d-4a4a-8482-1e185dcb29bf tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1569 microversion: 2.1 time: 0.157493 May 19 12:41:48.508665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 687/1288] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:48 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:49.525436 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7e7b548a-9167-4cf9-b90a-3a18563a890c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:49.526038 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7e7b548a-9167-4cf9-b90a-3a18563a890c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:49.532366 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7e7b548a-9167-4cf9-b90a-3a18563a890c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:49.532814 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7e7b548a-9167-4cf9-b90a-3a18563a890c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:49.533580 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7e7b548a-9167-4cf9-b90a-3a18563a890c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:49.534016 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7e7b548a-9167-4cf9-b90a-3a18563a890c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:49.665340 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7e7b548a-9167-4cf9-b90a-3a18563a890c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:49.672941 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7e7b548a-9167-4cf9-b90a-3a18563a890c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1570 microversion: 2.1 time: 0.151957 May 19 12:41:49.673512 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 602/1289] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:49 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:49.690043 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ca255efa-fe46-40bc-9a3a-53371c5b01e8 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:41:49.690670 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ca255efa-fe46-40bc-9a3a-53371c5b01e8 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:49.697574 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca255efa-fe46-40bc-9a3a-53371c5b01e8 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:49.698016 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca255efa-fe46-40bc-9a3a-53371c5b01e8 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:49.698796 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca255efa-fe46-40bc-9a3a-53371c5b01e8 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:49.699224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ca255efa-fe46-40bc-9a3a-53371c5b01e8 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:50.006377 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ca255efa-fe46-40bc-9a3a-53371c5b01e8 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "POST /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240/action" status: 202 len: 0 microversion: 2.1 time: 0.319921 May 19 12:41:50.007218 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 688/1290] 10.222.0.57 () {60 vars in 1277 bytes} [Thu May 19 12:41:49 2022] POST /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:41:50.015406 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-c8a746b2-7d4d-4b6a-a281-421e78519e0f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:50.016046 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-c8a746b2-7d4d-4b6a-a281-421e78519e0f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:50.023116 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c8a746b2-7d4d-4b6a-a281-421e78519e0f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:50.023660 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c8a746b2-7d4d-4b6a-a281-421e78519e0f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:50.024963 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c8a746b2-7d4d-4b6a-a281-421e78519e0f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:50.025540 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-c8a746b2-7d4d-4b6a-a281-421e78519e0f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:50.163627 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-c8a746b2-7d4d-4b6a-a281-421e78519e0f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:50.171170 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-c8a746b2-7d4d-4b6a-a281-421e78519e0f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1518 microversion: 2.1 time: 0.159765 May 19 12:41:50.171737 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 603/1291] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:50 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:51.190930 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-800a4218-2943-4052-b0c8-5591d64df14f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:51.191541 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-800a4218-2943-4052-b0c8-5591d64df14f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:51.198425 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-800a4218-2943-4052-b0c8-5591d64df14f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:51.198893 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-800a4218-2943-4052-b0c8-5591d64df14f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:51.199662 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-800a4218-2943-4052-b0c8-5591d64df14f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:51.200098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-800a4218-2943-4052-b0c8-5591d64df14f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:51.340794 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-800a4218-2943-4052-b0c8-5591d64df14f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:51.354652 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-800a4218-2943-4052-b0c8-5591d64df14f tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1520 microversion: 2.1 time: 0.168640 May 19 12:41:51.355254 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 689/1292] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:51 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:52.372123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6deffc85-38fb-4a0b-ba22-bb546e0cee6a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:52.372722 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6deffc85-38fb-4a0b-ba22-bb546e0cee6a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:52.379541 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6deffc85-38fb-4a0b-ba22-bb546e0cee6a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:52.380025 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6deffc85-38fb-4a0b-ba22-bb546e0cee6a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:52.381334 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6deffc85-38fb-4a0b-ba22-bb546e0cee6a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:52.381770 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6deffc85-38fb-4a0b-ba22-bb546e0cee6a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:52.525936 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6deffc85-38fb-4a0b-ba22-bb546e0cee6a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:52.533735 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6deffc85-38fb-4a0b-ba22-bb546e0cee6a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1520 microversion: 2.1 time: 0.165323 May 19 12:41:52.539368 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 604/1293] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:52 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:52.598378 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-4ca9104c-9cb6-4111-b1a8-e8f10cc115e7 req-68618b40-04cb-455e-850d-5526f939c4ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2beb7602-f905-4c4b-99cb-d09ed934c240", "name": "network-vif-unplugged", "status": "completed", "tag": "773e254a-2926-43ce-b4b2-88eca458ded1"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:41:52.607659 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-4ca9104c-9cb6-4111-b1a8-e8f10cc115e7 req-68618b40-04cb-455e-850d-5526f939c4ae service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:52.608180 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-4ca9104c-9cb6-4111-b1a8-e8f10cc115e7 req-68618b40-04cb-455e-850d-5526f939c4ae service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:52.619660 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-4ca9104c-9cb6-4111-b1a8-e8f10cc115e7 req-68618b40-04cb-455e-850d-5526f939c4ae service nova] Creating event network-vif-unplugged:773e254a-2926-43ce-b4b2-88eca458ded1 for instance 2beb7602-f905-4c4b-99cb-d09ed934c240 on hv-cinder-77819 May 19 12:41:52.624818 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-4ca9104c-9cb6-4111-b1a8-e8f10cc115e7 req-68618b40-04cb-455e-850d-5526f939c4ae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030745 May 19 12:41:52.625477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 690/1294] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:41:53.550663 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0145f58f-64d1-4b47-97ae-65d031e05589 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:53.551200 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0145f58f-64d1-4b47-97ae-65d031e05589 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:53.558149 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0145f58f-64d1-4b47-97ae-65d031e05589 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:53.558634 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0145f58f-64d1-4b47-97ae-65d031e05589 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:53.559402 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0145f58f-64d1-4b47-97ae-65d031e05589 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:53.559833 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0145f58f-64d1-4b47-97ae-65d031e05589 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:53.693162 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0145f58f-64d1-4b47-97ae-65d031e05589 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:53.700940 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0145f58f-64d1-4b47-97ae-65d031e05589 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1576 microversion: 2.1 time: 0.154415 May 19 12:41:53.701509 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 605/1295] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:53 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:54.719577 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-629bde40-3960-409b-aa1a-70ce9045d627 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:54.720283 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-629bde40-3960-409b-aa1a-70ce9045d627 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:54.726594 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-629bde40-3960-409b-aa1a-70ce9045d627 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:54.727034 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-629bde40-3960-409b-aa1a-70ce9045d627 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:54.727789 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-629bde40-3960-409b-aa1a-70ce9045d627 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:54.728217 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-629bde40-3960-409b-aa1a-70ce9045d627 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:54.860489 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-629bde40-3960-409b-aa1a-70ce9045d627 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:54.874027 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-629bde40-3960-409b-aa1a-70ce9045d627 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1576 microversion: 2.1 time: 0.158908 May 19 12:41:54.874638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 691/1296] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:54 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:55.892111 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-8478dcb7-f857-4e80-97c9-cde01ee5fc43 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:55.892682 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-8478dcb7-f857-4e80-97c9-cde01ee5fc43 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:55.901246 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8478dcb7-f857-4e80-97c9-cde01ee5fc43 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:55.901698 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8478dcb7-f857-4e80-97c9-cde01ee5fc43 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:55.902490 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8478dcb7-f857-4e80-97c9-cde01ee5fc43 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:55.902930 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-8478dcb7-f857-4e80-97c9-cde01ee5fc43 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:56.038172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-8478dcb7-f857-4e80-97c9-cde01ee5fc43 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:56.045730 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-8478dcb7-f857-4e80-97c9-cde01ee5fc43 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1576 microversion: 2.1 time: 0.157639 May 19 12:41:56.046296 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 606/1297] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:55 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:57.063619 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-fad4d5d8-3f40-4f42-b817-ff158dc57486 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:57.064265 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-fad4d5d8-3f40-4f42-b817-ff158dc57486 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:57.072171 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fad4d5d8-3f40-4f42-b817-ff158dc57486 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:57.072624 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fad4d5d8-3f40-4f42-b817-ff158dc57486 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:57.073421 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fad4d5d8-3f40-4f42-b817-ff158dc57486 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:57.073854 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-fad4d5d8-3f40-4f42-b817-ff158dc57486 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:57.202619 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-fad4d5d8-3f40-4f42-b817-ff158dc57486 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:57.210190 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-fad4d5d8-3f40-4f42-b817-ff158dc57486 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1576 microversion: 2.1 time: 0.150408 May 19 12:41:57.215709 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 692/1298] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:57 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:58.227874 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dd37acda-2050-4776-92fc-43429d63c93e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:58.228489 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dd37acda-2050-4776-92fc-43429d63c93e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:58.235227 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dd37acda-2050-4776-92fc-43429d63c93e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:58.235678 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dd37acda-2050-4776-92fc-43429d63c93e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:58.236437 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dd37acda-2050-4776-92fc-43429d63c93e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:58.236871 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dd37acda-2050-4776-92fc-43429d63c93e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:58.365445 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dd37acda-2050-4776-92fc-43429d63c93e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:58.373019 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dd37acda-2050-4776-92fc-43429d63c93e tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1576 microversion: 2.1 time: 0.149573 May 19 12:41:58.373593 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 607/1299] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:58 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:41:59.390699 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a0585f6c-eb87-438b-8d13-4bc75acc0e08 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:41:59.391307 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a0585f6c-eb87-438b-8d13-4bc75acc0e08 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:41:59.398111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a0585f6c-eb87-438b-8d13-4bc75acc0e08 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:59.398581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a0585f6c-eb87-438b-8d13-4bc75acc0e08 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:59.399339 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a0585f6c-eb87-438b-8d13-4bc75acc0e08 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:41:59.399752 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a0585f6c-eb87-438b-8d13-4bc75acc0e08 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:41:59.532779 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-a0585f6c-eb87-438b-8d13-4bc75acc0e08 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:41:59.540840 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a0585f6c-eb87-438b-8d13-4bc75acc0e08 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1576 microversion: 2.1 time: 0.154268 May 19 12:41:59.541402 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 693/1300] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:41:59 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:42:00.557684 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-f1bb9c63-a6c5-4298-9bd3-d8d00f0ed25d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:00.562989 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-f1bb9c63-a6c5-4298-9bd3-d8d00f0ed25d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:00.565041 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f1bb9c63-a6c5-4298-9bd3-d8d00f0ed25d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:00.565497 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f1bb9c63-a6c5-4298-9bd3-d8d00f0ed25d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:00.566260 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f1bb9c63-a6c5-4298-9bd3-d8d00f0ed25d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:00.566719 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-f1bb9c63-a6c5-4298-9bd3-d8d00f0ed25d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:00.697460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-f1bb9c63-a6c5-4298-9bd3-d8d00f0ed25d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:00.704999 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-f1bb9c63-a6c5-4298-9bd3-d8d00f0ed25d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1576 microversion: 2.1 time: 0.151399 May 19 12:42:00.705566 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 608/1301] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:00 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:42:01.722648 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2db9431b-6a47-43a6-b4ba-971c9f090087 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:01.723260 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2db9431b-6a47-43a6-b4ba-971c9f090087 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:01.730303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2db9431b-6a47-43a6-b4ba-971c9f090087 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:01.730799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2db9431b-6a47-43a6-b4ba-971c9f090087 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:01.731560 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2db9431b-6a47-43a6-b4ba-971c9f090087 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:01.731998 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2db9431b-6a47-43a6-b4ba-971c9f090087 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:01.867736 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2db9431b-6a47-43a6-b4ba-971c9f090087 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:01.875316 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2db9431b-6a47-43a6-b4ba-971c9f090087 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1576 microversion: 2.1 time: 0.156532 May 19 12:42:01.875885 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 694/1302] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:01 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:02.892393 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-72586f87-ff3b-4877-817a-cbe59fabb2c3 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:02.893007 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-72586f87-ff3b-4877-817a-cbe59fabb2c3 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:02.899467 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-72586f87-ff3b-4877-817a-cbe59fabb2c3 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:02.899916 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-72586f87-ff3b-4877-817a-cbe59fabb2c3 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:02.900671 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-72586f87-ff3b-4877-817a-cbe59fabb2c3 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:02.901102 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-72586f87-ff3b-4877-817a-cbe59fabb2c3 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:03.033190 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-72586f87-ff3b-4877-817a-cbe59fabb2c3 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:03.041237 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-72586f87-ff3b-4877-817a-cbe59fabb2c3 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1576 microversion: 2.1 time: 0.152724 May 19 12:42:03.041805 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 609/1303] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:02 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:04.058814 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-380fbb11-f055-46fb-819e-5d164a2f23db tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:04.059417 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-380fbb11-f055-46fb-819e-5d164a2f23db tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:04.065790 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-380fbb11-f055-46fb-819e-5d164a2f23db tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:04.066231 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-380fbb11-f055-46fb-819e-5d164a2f23db tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:04.067013 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-380fbb11-f055-46fb-819e-5d164a2f23db tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:04.068060 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-380fbb11-f055-46fb-819e-5d164a2f23db tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:04.199636 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-380fbb11-f055-46fb-819e-5d164a2f23db tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:04.207234 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-380fbb11-f055-46fb-819e-5d164a2f23db tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1576 microversion: 2.1 time: 0.152568 May 19 12:42:04.207794 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 695/1304] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:04 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:04.587199 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-6df381de-c28c-422e-bc5a-5d44c159416b req-c44c9835-0598-48df-ba60-7cc0e972f0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2beb7602-f905-4c4b-99cb-d09ed934c240", "name": "network-vif-plugged", "status": "completed", "tag": "773e254a-2926-43ce-b4b2-88eca458ded1"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:42:04.596909 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-6df381de-c28c-422e-bc5a-5d44c159416b req-c44c9835-0598-48df-ba60-7cc0e972f0c1 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:04.597358 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-6df381de-c28c-422e-bc5a-5d44c159416b req-c44c9835-0598-48df-ba60-7cc0e972f0c1 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:04.608806 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-6df381de-c28c-422e-bc5a-5d44c159416b req-c44c9835-0598-48df-ba60-7cc0e972f0c1 service nova] Creating event network-vif-plugged:773e254a-2926-43ce-b4b2-88eca458ded1 for instance 2beb7602-f905-4c4b-99cb-d09ed934c240 on hv-cinder-77819 May 19 12:42:04.613849 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-6df381de-c28c-422e-bc5a-5d44c159416b req-c44c9835-0598-48df-ba60-7cc0e972f0c1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030483 May 19 12:42:04.615509 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 610/1305] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:42:05.223954 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-25676121-87f7-44c0-97ae-ee7bb8948cb1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:05.224614 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-25676121-87f7-44c0-97ae-ee7bb8948cb1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:05.231107 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25676121-87f7-44c0-97ae-ee7bb8948cb1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:05.231557 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25676121-87f7-44c0-97ae-ee7bb8948cb1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:05.232314 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25676121-87f7-44c0-97ae-ee7bb8948cb1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:05.232745 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-25676121-87f7-44c0-97ae-ee7bb8948cb1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:05.361975 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-25676121-87f7-44c0-97ae-ee7bb8948cb1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:05.369996 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-25676121-87f7-44c0-97ae-ee7bb8948cb1 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1576 microversion: 2.1 time: 0.149852 May 19 12:42:05.370596 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 696/1306] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:05 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:06.387910 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-da0674fb-bbd5-4ecd-a991-2f30268b1d9a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:06.388698 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-da0674fb-bbd5-4ecd-a991-2f30268b1d9a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:06.390686 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=31 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:06.396155 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da0674fb-bbd5-4ecd-a991-2f30268b1d9a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:06.396665 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da0674fb-bbd5-4ecd-a991-2f30268b1d9a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:06.397472 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da0674fb-bbd5-4ecd-a991-2f30268b1d9a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:06.397915 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-da0674fb-bbd5-4ecd-a991-2f30268b1d9a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:06.400570 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:06.535477 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-da0674fb-bbd5-4ecd-a991-2f30268b1d9a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:06.543372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-da0674fb-bbd5-4ecd-a991-2f30268b1d9a tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1576 microversion: 2.1 time: 0.160066 May 19 12:42:06.544252 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 611/1307] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:06 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:07.561064 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-090b836c-7454-4f15-ba16-b7182ce287e6 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:07.561692 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-090b836c-7454-4f15-ba16-b7182ce287e6 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:07.564125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=33 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:07.569185 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-090b836c-7454-4f15-ba16-b7182ce287e6 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:07.569632 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-090b836c-7454-4f15-ba16-b7182ce287e6 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:07.570683 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-090b836c-7454-4f15-ba16-b7182ce287e6 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:07.571117 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-090b836c-7454-4f15-ba16-b7182ce287e6 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:07.705403 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-090b836c-7454-4f15-ba16-b7182ce287e6 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:07.713584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-090b836c-7454-4f15-ba16-b7182ce287e6 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1563 microversion: 2.1 time: 0.156296 May 19 12:42:07.714157 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 697/1308] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:07 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:31.468697 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2056773380", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1443882366", "security_groups": [{"name": "tempest-secgroup-smoke-333795976"}], "block_device_mapping_v2": [{"uuid": "db37688b-c3f8-45b7-9572-4b3302184d88", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d351609-6722-4245-b241-bc1661734268"}]}} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:42:31.477136 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:31.586314 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.network.neutron [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] validate_networks() for [('8d351609-6722-4245-b241-bc1661734268', None, None, None, None, None)] {{(pid=118111) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 12:42:31.995881 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Flavor limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 12:42:31.996318 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Image limits 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 12:42:31.996798 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Flavor pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 12:42:31.997206 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Image pref 0:0:0 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 12:42:31.997619 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.virt.hardware [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 12:42:32.006638 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:32.007083 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:32.007875 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:32.008308 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:32.026315 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Getting quotas for project ff5ebee4cf6c47f9adee30f9c8cd6ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 12:42:32.030466 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.quota [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Getting quotas for user 0beb4f30b5c34ab0afdbfbf46dbfede5 and project ff5ebee4cf6c47f9adee30f9c8cd6ba1. Resources: {'ram', 'instances', 'cores'} {{(pid=118111) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 12:42:32.087913 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Going to run 1 instances... {{(pid=118111) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 12:42:32.090052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='db37688b-c3f8-45b7-9572-4b3302184d88',volume_size=None,volume_type=None)] {{(pid=118111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 12:42:32.523271 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [bb4bb9c7-6116-4b94-9c81-a95f73c1c00c] AMQP server on 10.222.0.57:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 12:42:33.530214 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO oslo.messaging._drivers.impl_rabbit [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [bb4bb9c7-6116-4b94-9c81-a95f73c1c00c] Reconnected to AMQP server on 10.222.0.57:5672 via [amqp] client with port 39206. May 19 12:42:33.533940 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5b9aa744-a02a-4ddb-9ca8-fd509ac4aa8e tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.069727 May 19 12:42:33.534628 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 612/1309] 10.222.0.57 () {60 vars in 1146 bytes} [Thu May 19 12:42:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 2071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 12:42:33.545159 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f2e9943d-3b33-4761-909d-702a473f8679 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:33.545767 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f2e9943d-3b33-4761-909d-702a473f8679 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:33.547781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:33.548436 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:33.600846 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f2e9943d-3b33-4761-909d-702a473f8679 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:33.607370 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f2e9943d-3b33-4761-909d-702a473f8679 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1095 microversion: 2.1 time: 0.066162 May 19 12:42:33.608001 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 698/1310] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:33 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:34.625321 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-317fdc22-838b-46e1-be13-cb30d86a9d30 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:34.625948 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-317fdc22-838b-46e1-be13-cb30d86a9d30 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:34.679590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-317fdc22-838b-46e1-be13-cb30d86a9d30 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:34.687052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-317fdc22-838b-46e1-be13-cb30d86a9d30 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1095 microversion: 2.1 time: 0.065924 May 19 12:42:34.687624 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 613/1311] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:34 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:35.704705 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-bc883efe-9659-4936-88c2-685745091bcf tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:35.705321 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-bc883efe-9659-4936-88c2-685745091bcf tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:35.758428 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bc883efe-9659-4936-88c2-685745091bcf tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:35.766474 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-bc883efe-9659-4936-88c2-685745091bcf tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1095 microversion: 2.1 time: 0.066050 May 19 12:42:35.767027 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 699/1312] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:35 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:36.783146 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a9a4d735-81fd-407c-a8cb-e3b7673e89a6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:36.783793 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a9a4d735-81fd-407c-a8cb-e3b7673e89a6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:36.839106 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a9a4d735-81fd-407c-a8cb-e3b7673e89a6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:36.845816 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a9a4d735-81fd-407c-a8cb-e3b7673e89a6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1095 microversion: 2.1 time: 0.066549 May 19 12:42:36.846389 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 614/1313] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:36 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:37.519004 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:42:37.519198 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Thu May 19 12:42:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:42:37.866525 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ffef5657-6274-4e3b-a875-84ee0ac88f0d tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:37.867141 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ffef5657-6274-4e3b-a875-84ee0ac88f0d tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:37.873638 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ffef5657-6274-4e3b-a875-84ee0ac88f0d tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:37.874090 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ffef5657-6274-4e3b-a875-84ee0ac88f0d tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:37.874878 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ffef5657-6274-4e3b-a875-84ee0ac88f0d tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:37.875314 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ffef5657-6274-4e3b-a875-84ee0ac88f0d tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:37.934729 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ffef5657-6274-4e3b-a875-84ee0ac88f0d tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:37.942142 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ffef5657-6274-4e3b-a875-84ee0ac88f0d tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1145 microversion: 2.1 time: 0.079732 May 19 12:42:37.943419 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 700/1314] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:37 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:38.959172 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-e7de64e1-8e7e-4d1b-ab4a-54a6a1583e93 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:38.959722 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-e7de64e1-8e7e-4d1b-ab4a-54a6a1583e93 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:38.966267 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e7de64e1-8e7e-4d1b-ab4a-54a6a1583e93 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:38.966759 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e7de64e1-8e7e-4d1b-ab4a-54a6a1583e93 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:38.967524 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e7de64e1-8e7e-4d1b-ab4a-54a6a1583e93 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:38.968051 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-e7de64e1-8e7e-4d1b-ab4a-54a6a1583e93 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:39.031173 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-e7de64e1-8e7e-4d1b-ab4a-54a6a1583e93 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:39.039155 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-e7de64e1-8e7e-4d1b-ab4a-54a6a1583e93 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1193 microversion: 2.1 time: 0.084332 May 19 12:42:39.039718 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 615/1315] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:38 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:40.056885 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-252a0483-f5d3-48f5-bbbb-fc87abc338c6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:40.057654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-252a0483-f5d3-48f5-bbbb-fc87abc338c6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:40.064339 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-252a0483-f5d3-48f5-bbbb-fc87abc338c6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:40.064793 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-252a0483-f5d3-48f5-bbbb-fc87abc338c6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:40.065567 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-252a0483-f5d3-48f5-bbbb-fc87abc338c6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:40.066008 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-252a0483-f5d3-48f5-bbbb-fc87abc338c6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:40.265442 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-252a0483-f5d3-48f5-bbbb-fc87abc338c6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:40.273759 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-252a0483-f5d3-48f5-bbbb-fc87abc338c6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1278 microversion: 2.1 time: 0.221462 May 19 12:42:40.274348 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 701/1316] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:40 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1278 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:41.291709 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-7c1b86c5-13cc-4137-8ac5-acc3821c5545 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:41.292331 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-7c1b86c5-13cc-4137-8ac5-acc3821c5545 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:41.299003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7c1b86c5-13cc-4137-8ac5-acc3821c5545 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:41.299457 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7c1b86c5-13cc-4137-8ac5-acc3821c5545 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:41.300228 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7c1b86c5-13cc-4137-8ac5-acc3821c5545 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:41.300666 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-7c1b86c5-13cc-4137-8ac5-acc3821c5545 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:41.399154 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-e3be4996-33d7-4135-8607-9859fd11aee4 req-a98822ec-bfd2-4788-8531-90adf9f710b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8998364-4819-41a7-8bba-1c1513ed3b79", "tag": "679d8251-6e6d-4196-9c59-d5039983357d"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:42:41.408969 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-e3be4996-33d7-4135-8607-9859fd11aee4 req-a98822ec-bfd2-4788-8531-90adf9f710b8 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:41.409410 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-e3be4996-33d7-4135-8607-9859fd11aee4 req-a98822ec-bfd2-4788-8531-90adf9f710b8 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:41.424458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-e3be4996-33d7-4135-8607-9859fd11aee4 req-a98822ec-bfd2-4788-8531-90adf9f710b8 service nova] Creating event network-changed:679d8251-6e6d-4196-9c59-d5039983357d for instance b8998364-4819-41a7-8bba-1c1513ed3b79 on hv-cinder-77819 May 19 12:42:41.430896 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-e3be4996-33d7-4135-8607-9859fd11aee4 req-a98822ec-bfd2-4788-8531-90adf9f710b8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041700 May 19 12:42:41.431781 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 702/1317] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:42:41.521044 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-7c1b86c5-13cc-4137-8ac5-acc3821c5545 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:41.530197 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-7c1b86c5-13cc-4137-8ac5-acc3821c5545 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1266 microversion: 2.1 time: 0.242337 May 19 12:42:41.540078 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 616/1318] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:41 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:42.547984 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-9c404d91-dcb5-4ac8-8332-01c4dd520c58 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:42.548674 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-9c404d91-dcb5-4ac8-8332-01c4dd520c58 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:42.555476 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9c404d91-dcb5-4ac8-8332-01c4dd520c58 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:42.556733 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9c404d91-dcb5-4ac8-8332-01c4dd520c58 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:42.556988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9c404d91-dcb5-4ac8-8332-01c4dd520c58 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:42.557423 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-9c404d91-dcb5-4ac8-8332-01c4dd520c58 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:42.690570 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-9c404d91-dcb5-4ac8-8332-01c4dd520c58 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:42.698728 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-9c404d91-dcb5-4ac8-8332-01c4dd520c58 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1266 microversion: 2.1 time: 0.154857 May 19 12:42:42.699298 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 703/1319] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:42 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:42:43.715531 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5d41cbe8-7a59-4f00-82d1-0c2044a8e310 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:43.716135 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5d41cbe8-7a59-4f00-82d1-0c2044a8e310 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:43.717953 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=2 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:43.723335 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d41cbe8-7a59-4f00-82d1-0c2044a8e310 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:43.724403 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d41cbe8-7a59-4f00-82d1-0c2044a8e310 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:43.725247 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d41cbe8-7a59-4f00-82d1-0c2044a8e310 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:43.725673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5d41cbe8-7a59-4f00-82d1-0c2044a8e310 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:43.855669 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-5d41cbe8-7a59-4f00-82d1-0c2044a8e310 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:43.863042 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5d41cbe8-7a59-4f00-82d1-0c2044a8e310 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1266 microversion: 2.1 time: 0.151591 May 19 12:42:43.863596 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 617/1320] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:43 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:44.880170 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-78a7a1b4-7ea6-4b3f-808a-3d9e6f3848fc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:44.880992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-78a7a1b4-7ea6-4b3f-808a-3d9e6f3848fc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:44.887598 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78a7a1b4-7ea6-4b3f-808a-3d9e6f3848fc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:44.888054 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78a7a1b4-7ea6-4b3f-808a-3d9e6f3848fc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:44.888821 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78a7a1b4-7ea6-4b3f-808a-3d9e6f3848fc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:44.889267 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-78a7a1b4-7ea6-4b3f-808a-3d9e6f3848fc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:45.020370 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-78a7a1b4-7ea6-4b3f-808a-3d9e6f3848fc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:45.028375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-78a7a1b4-7ea6-4b3f-808a-3d9e6f3848fc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1266 microversion: 2.1 time: 0.152493 May 19 12:42:45.028951 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 704/1321] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:44 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:46.044984 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-d3d4c680-7a3b-4e99-8738-89dbeab083b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:46.045603 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-d3d4c680-7a3b-4e99-8738-89dbeab083b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:46.052702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3d4c680-7a3b-4e99-8738-89dbeab083b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:46.053150 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3d4c680-7a3b-4e99-8738-89dbeab083b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:46.053914 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3d4c680-7a3b-4e99-8738-89dbeab083b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:46.054347 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-d3d4c680-7a3b-4e99-8738-89dbeab083b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:46.186671 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-d3d4c680-7a3b-4e99-8738-89dbeab083b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:46.194749 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-d3d4c680-7a3b-4e99-8738-89dbeab083b5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1266 microversion: 2.1 time: 0.153539 May 19 12:42:46.195313 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 618/1322] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:46 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:47.211358 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-f8dd72fd-1bfa-4c92-a577-ab2c810dd9d6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:47.211988 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-f8dd72fd-1bfa-4c92-a577-ab2c810dd9d6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:47.213985 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell0:SELECT=4 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:47.219248 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8dd72fd-1bfa-4c92-a577-ab2c810dd9d6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:47.219690 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8dd72fd-1bfa-4c92-a577-ab2c810dd9d6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:47.220444 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8dd72fd-1bfa-4c92-a577-ab2c810dd9d6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:47.220880 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-f8dd72fd-1bfa-4c92-a577-ab2c810dd9d6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:47.352003 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-f8dd72fd-1bfa-4c92-a577-ab2c810dd9d6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:47.359563 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-f8dd72fd-1bfa-4c92-a577-ab2c810dd9d6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1266 microversion: 2.1 time: 0.152838 May 19 12:42:47.360134 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 705/1323] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:47 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:42:48.375854 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0bbfcf74-9efa-49a8-81e7-cd750ad1feeb tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:48.376495 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0bbfcf74-9efa-49a8-81e7-cd750ad1feeb tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:48.378460 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell0:SELECT=10 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:42:48.383840 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0bbfcf74-9efa-49a8-81e7-cd750ad1feeb tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:48.384293 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0bbfcf74-9efa-49a8-81e7-cd750ad1feeb tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:48.385052 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0bbfcf74-9efa-49a8-81e7-cd750ad1feeb tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:48.385488 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0bbfcf74-9efa-49a8-81e7-cd750ad1feeb tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:48.522123 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0bbfcf74-9efa-49a8-81e7-cd750ad1feeb tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:48.529570 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0bbfcf74-9efa-49a8-81e7-cd750ad1feeb tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1266 microversion: 2.1 time: 0.157624 May 19 12:42:48.530129 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 619/1324] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:48 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:42:49.546067 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-ea629829-c0b4-46b0-8147-c1435b4cebb8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:49.546691 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-ea629829-c0b4-46b0-8147-c1435b4cebb8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:49.553997 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ea629829-c0b4-46b0-8147-c1435b4cebb8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:49.554467 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ea629829-c0b4-46b0-8147-c1435b4cebb8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:49.555245 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ea629829-c0b4-46b0-8147-c1435b4cebb8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:49.555934 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-ea629829-c0b4-46b0-8147-c1435b4cebb8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:49.688594 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-ea629829-c0b4-46b0-8147-c1435b4cebb8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:49.696734 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-ea629829-c0b4-46b0-8147-c1435b4cebb8 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1266 microversion: 2.1 time: 0.154546 May 19 12:42:49.698927 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 706/1325] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:49 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:50.713168 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-6892ffd2-d291-4580-ba10-8662853b7240 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:50.713831 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-6892ffd2-d291-4580-ba10-8662853b7240 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:50.720241 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6892ffd2-d291-4580-ba10-8662853b7240 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:50.720687 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6892ffd2-d291-4580-ba10-8662853b7240 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:50.721478 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6892ffd2-d291-4580-ba10-8662853b7240 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:50.721915 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-6892ffd2-d291-4580-ba10-8662853b7240 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:50.854529 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-6892ffd2-d291-4580-ba10-8662853b7240 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:50.862299 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-6892ffd2-d291-4580-ba10-8662853b7240 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1266 microversion: 2.1 time: 0.152913 May 19 12:42:50.862901 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 620/1326] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:50 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:51.878960 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-58b2f30c-275b-4053-a41f-f5161d213b0b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:51.880211 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-58b2f30c-275b-4053-a41f-f5161d213b0b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:51.886586 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-58b2f30c-275b-4053-a41f-f5161d213b0b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:51.887035 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-58b2f30c-275b-4053-a41f-f5161d213b0b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:51.887794 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-58b2f30c-275b-4053-a41f-f5161d213b0b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:51.888224 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-58b2f30c-275b-4053-a41f-f5161d213b0b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:52.019906 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-58b2f30c-275b-4053-a41f-f5161d213b0b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:52.029125 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-58b2f30c-275b-4053-a41f-f5161d213b0b tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1266 microversion: 2.1 time: 0.153955 May 19 12:42:52.029707 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 707/1327] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:51 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:53.005096 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-75e55d46-0275-40ac-b0ab-b493bf78cb76 req-4c58bcc0-781a-4065-b184-9b438dd8c0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8998364-4819-41a7-8bba-1c1513ed3b79", "name": "network-vif-plugged", "status": "completed", "tag": "679d8251-6e6d-4196-9c59-d5039983357d"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:42:53.013114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-75e55d46-0275-40ac-b0ab-b493bf78cb76 req-4c58bcc0-781a-4065-b184-9b438dd8c0b4 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:53.020096 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-75e55d46-0275-40ac-b0ab-b493bf78cb76 req-4c58bcc0-781a-4065-b184-9b438dd8c0b4 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:53.027114 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-75e55d46-0275-40ac-b0ab-b493bf78cb76 req-4c58bcc0-781a-4065-b184-9b438dd8c0b4 service nova] Creating event network-vif-plugged:679d8251-6e6d-4196-9c59-d5039983357d for instance b8998364-4819-41a7-8bba-1c1513ed3b79 on hv-cinder-77819 May 19 12:42:53.032091 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-75e55d46-0275-40ac-b0ab-b493bf78cb76 req-4c58bcc0-781a-4065-b184-9b438dd8c0b4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091485 May 19 12:42:53.032673 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 621/1328] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:42:53.046657 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-c5e027f5-b1af-4314-b251-c463214a2e47 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:53.056889 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-c5e027f5-b1af-4314-b251-c463214a2e47 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:53.065124 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c5e027f5-b1af-4314-b251-c463214a2e47 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:53.066065 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c5e027f5-b1af-4314-b251-c463214a2e47 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:53.068072 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c5e027f5-b1af-4314-b251-c463214a2e47 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:53.068664 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-c5e027f5-b1af-4314-b251-c463214a2e47 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:53.205115 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-c5e027f5-b1af-4314-b251-c463214a2e47 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:53.213244 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-c5e027f5-b1af-4314-b251-c463214a2e47 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1266 microversion: 2.1 time: 0.170553 May 19 12:42:53.213810 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 708/1329] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:53 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:54.231584 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-dc177499-f9da-48d7-be2b-ed8b44d46ec6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:54.232285 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-dc177499-f9da-48d7-be2b-ed8b44d46ec6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:54.242530 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc177499-f9da-48d7-be2b-ed8b44d46ec6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:54.242977 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc177499-f9da-48d7-be2b-ed8b44d46ec6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:54.243748 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc177499-f9da-48d7-be2b-ed8b44d46ec6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:54.244229 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-dc177499-f9da-48d7-be2b-ed8b44d46ec6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:54.378948 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-dc177499-f9da-48d7-be2b-ed8b44d46ec6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:54.386480 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-dc177499-f9da-48d7-be2b-ed8b44d46ec6 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1266 microversion: 2.1 time: 0.159698 May 19 12:42:54.387044 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 622/1330] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:54 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:55.403994 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-6de1e317-d5f9-458a-995e-5f6b8fb3ad3a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:55.404587 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-6de1e317-d5f9-458a-995e-5f6b8fb3ad3a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:55.411346 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6de1e317-d5f9-458a-995e-5f6b8fb3ad3a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:55.414276 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6de1e317-d5f9-458a-995e-5f6b8fb3ad3a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:55.414276 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6de1e317-d5f9-458a-995e-5f6b8fb3ad3a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:55.414276 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-6de1e317-d5f9-458a-995e-5f6b8fb3ad3a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:55.553033 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-6de1e317-d5f9-458a-995e-5f6b8fb3ad3a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:55.561584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-6de1e317-d5f9-458a-995e-5f6b8fb3ad3a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1454 microversion: 2.1 time: 0.161756 May 19 12:42:55.566335 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 709/1331] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:55 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:42:55.577660 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-63d77f40-defc-41e2-8197-bf3168ce6664 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:42:55.578272 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-63d77f40-defc-41e2-8197-bf3168ce6664 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:42:55.585323 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-63d77f40-defc-41e2-8197-bf3168ce6664 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:55.585770 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-63d77f40-defc-41e2-8197-bf3168ce6664 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:55.586604 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-63d77f40-defc-41e2-8197-bf3168ce6664 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:55.587009 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-63d77f40-defc-41e2-8197-bf3168ce6664 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:55.716912 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-63d77f40-defc-41e2-8197-bf3168ce6664 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:42:55.725251 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-63d77f40-defc-41e2-8197-bf3168ce6664 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1454 microversion: 2.1 time: 0.151348 May 19 12:42:55.725817 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 623/1332] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:42:55 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:42:57.746832 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-08f6d252-f6fd-40f9-a809-2284567d4945 req-069f3955-1b78-42ac-9e60-f76f8e0caedf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8998364-4819-41a7-8bba-1c1513ed3b79", "tag": "679d8251-6e6d-4196-9c59-d5039983357d"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:42:57.755375 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-08f6d252-f6fd-40f9-a809-2284567d4945 req-069f3955-1b78-42ac-9e60-f76f8e0caedf service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:42:57.755818 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-08f6d252-f6fd-40f9-a809-2284567d4945 req-069f3955-1b78-42ac-9e60-f76f8e0caedf service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:42:57.766982 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-08f6d252-f6fd-40f9-a809-2284567d4945 req-069f3955-1b78-42ac-9e60-f76f8e0caedf service nova] Creating event network-changed:679d8251-6e6d-4196-9c59-d5039983357d for instance b8998364-4819-41a7-8bba-1c1513ed3b79 on hv-cinder-77819 May 19 12:42:57.772710 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-08f6d252-f6fd-40f9-a809-2284567d4945 req-069f3955-1b78-42ac-9e60-f76f8e0caedf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029408 May 19 12:42:57.773581 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 710/1333] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:43:45.222672 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=30 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:45.226735 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-1d7e1744-5c2d-470e-9630-6440914d594c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:43:45.227266 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=58 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:45.227383 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1d7e1744-5c2d-470e-9630-6440914d594c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:43:45.227383 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:45.227944 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=57 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:43:45.235072 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1d7e1744-5c2d-470e-9630-6440914d594c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:45.235522 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1d7e1744-5c2d-470e-9630-6440914d594c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:45.236292 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1d7e1744-5c2d-470e-9630-6440914d594c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:45.236721 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-1d7e1744-5c2d-470e-9630-6440914d594c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:45.263745 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-1d7e1744-5c2d-470e-9630-6440914d594c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Going to try to terminate instance {{(pid=118111) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:43:45.288333 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [req-333d48f5-a154-4ba3-bfe2-e1a1c9411e66 req-20eb07a2-6545-44dc-9a7b-dd764ae0b091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2beb7602-f905-4c4b-99cb-d09ed934c240", "tag": "773e254a-2926-43ce-b4b2-88eca458ded1"}]} {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:43:45.298398 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-333d48f5-a154-4ba3-bfe2-e1a1c9411e66 req-20eb07a2-6545-44dc-9a7b-dd764ae0b091 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:45.298398 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [req-333d48f5-a154-4ba3-bfe2-e1a1c9411e66 req-20eb07a2-6545-44dc-9a7b-dd764ae0b091 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:45.311408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.compute.server_external_events [req-333d48f5-a154-4ba3-bfe2-e1a1c9411e66 req-20eb07a2-6545-44dc-9a7b-dd764ae0b091 service nova] Creating event network-changed:773e254a-2926-43ce-b4b2-88eca458ded1 for instance 2beb7602-f905-4c4b-99cb-d09ed934c240 on hv-cinder-77819 May 19 12:43:45.316010 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [req-333d48f5-a154-4ba3-bfe2-e1a1c9411e66 req-20eb07a2-6545-44dc-9a7b-dd764ae0b091 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094918 May 19 12:43:45.317477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 711/1334] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:43:45.612619 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-1d7e1744-5c2d-470e-9630-6440914d594c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 204 len: 0 microversion: 2.1 time: 0.393808 May 19 12:43:45.613561 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 624/1335] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:43:45 2022] DELETE /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:43:45.624046 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-7067a912-5ed1-40b8-be8e-d73bd25fa29b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:43:45.625060 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-7067a912-5ed1-40b8-be8e-d73bd25fa29b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:43:45.632385 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7067a912-5ed1-40b8-be8e-d73bd25fa29b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:45.633188 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7067a912-5ed1-40b8-be8e-d73bd25fa29b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:45.633960 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7067a912-5ed1-40b8-be8e-d73bd25fa29b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:45.634837 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-7067a912-5ed1-40b8-be8e-d73bd25fa29b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:45.816984 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-7067a912-5ed1-40b8-be8e-d73bd25fa29b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:43:45.825433 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-7067a912-5ed1-40b8-be8e-d73bd25fa29b tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1569 microversion: 2.1 time: 0.207287 May 19 12:43:45.826258 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 712/1336] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:43:45 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:43:46.844158 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-0a58fd7b-9632-41c9-b9cf-fbbbb807feae tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:43:46.844851 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-0a58fd7b-9632-41c9-b9cf-fbbbb807feae tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:43:46.851724 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a58fd7b-9632-41c9-b9cf-fbbbb807feae tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:46.852203 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a58fd7b-9632-41c9-b9cf-fbbbb807feae tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:46.853037 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a58fd7b-9632-41c9-b9cf-fbbbb807feae tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:46.853516 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-0a58fd7b-9632-41c9-b9cf-fbbbb807feae tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:46.989372 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-0a58fd7b-9632-41c9-b9cf-fbbbb807feae tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:43:46.997377 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-0a58fd7b-9632-41c9-b9cf-fbbbb807feae tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1569 microversion: 2.1 time: 0.157479 May 19 12:43:46.997941 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 625/1337] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:43:46 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:43:48.015918 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-20109086-fd0f-47b0-adba-7e1d30ba9c3c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:43:48.016526 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-20109086-fd0f-47b0-adba-7e1d30ba9c3c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:43:48.023111 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-20109086-fd0f-47b0-adba-7e1d30ba9c3c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:48.025555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-20109086-fd0f-47b0-adba-7e1d30ba9c3c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:48.025555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-20109086-fd0f-47b0-adba-7e1d30ba9c3c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:48.025555 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-20109086-fd0f-47b0-adba-7e1d30ba9c3c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:48.069158 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-97e76390-e84a-4f2a-a240-ac9e77deb692 req-23037e30-0b54-4309-befa-4786297ed442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2beb7602-f905-4c4b-99cb-d09ed934c240", "name": "network-vif-deleted", "tag": "773e254a-2926-43ce-b4b2-88eca458ded1"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:43:48.077823 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-97e76390-e84a-4f2a-a240-ac9e77deb692 req-23037e30-0b54-4309-befa-4786297ed442 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:48.078264 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-97e76390-e84a-4f2a-a240-ac9e77deb692 req-23037e30-0b54-4309-befa-4786297ed442 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:48.089929 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-97e76390-e84a-4f2a-a240-ac9e77deb692 req-23037e30-0b54-4309-befa-4786297ed442 service nova] Creating event network-vif-deleted:773e254a-2926-43ce-b4b2-88eca458ded1 for instance 2beb7602-f905-4c4b-99cb-d09ed934c240 on hv-cinder-77819 May 19 12:43:48.096030 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-97e76390-e84a-4f2a-a240-ac9e77deb692 req-23037e30-0b54-4309-befa-4786297ed442 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030543 May 19 12:43:48.096339 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-20109086-fd0f-47b0-adba-7e1d30ba9c3c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:43:48.097276 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 626/1338] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:43:48.104369 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-20109086-fd0f-47b0-adba-7e1d30ba9c3c tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1382 microversion: 2.1 time: 0.093519 May 19 12:43:48.104944 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 713/1339] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:43:48 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1382 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 12:43:49.122590 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-2cd8ca7e-1c3a-49af-a428-e7a64c9d4778 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:43:49.123310 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-2cd8ca7e-1c3a-49af-a428-e7a64c9d4778 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:43:49.129633 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cd8ca7e-1c3a-49af-a428-e7a64c9d4778 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:49.130142 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cd8ca7e-1c3a-49af-a428-e7a64c9d4778 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:49.130962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cd8ca7e-1c3a-49af-a428-e7a64c9d4778 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:49.131422 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cd8ca7e-1c3a-49af-a428-e7a64c9d4778 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:49.161806 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cd8ca7e-1c3a-49af-a428-e7a64c9d4778 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:49.162246 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-2cd8ca7e-1c3a-49af-a428-e7a64c9d4778 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:49.162760 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.objects.instance [None req-2cd8ca7e-1c3a-49af-a428-e7a64c9d4778 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lazy-loading 'fault' on Instance uuid 2beb7602-f905-4c4b-99cb-d09ed934c240 {{(pid=118111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 12:43:49.208012 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-2cd8ca7e-1c3a-49af-a428-e7a64c9d4778 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2273aeca59c04c778683e70665b7efa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3a4bb3cecc4474e85a49a217fa98d9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:43:49.216153 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-2cd8ca7e-1c3a-49af-a428-e7a64c9d4778 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 200 len: 1224 microversion: 2.1 time: 0.099066 May 19 12:43:49.218290 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 627/1340] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:43:49 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:43:50.233553 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-54545d71-a4ef-4746-b27b-6a588957ef0d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:43:50.234152 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-54545d71-a4ef-4746-b27b-6a588957ef0d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] [instance: 2beb7602-f905-4c4b-99cb-d09ed934c240] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:43:50.241096 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-54545d71-a4ef-4746-b27b-6a588957ef0d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:50.241535 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-54545d71-a4ef-4746-b27b-6a588957ef0d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:50.242284 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-54545d71-a4ef-4746-b27b-6a588957ef0d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:43:50.242747 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-54545d71-a4ef-4746-b27b-6a588957ef0d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:43:50.256510 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-54545d71-a4ef-4746-b27b-6a588957ef0d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] HTTP exception thrown: Instance 2beb7602-f905-4c4b-99cb-d09ed934c240 could not be found. May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-54545d71-a4ef-4746-b27b-6a588957ef0d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Request method failure captured: May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 HTTP/1.1 May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjo7zo9t0zM-Ov3VhHzYPudw2Txvx56aTo40Bfd7abN9UCgKgf9b1hUCK6vkiWqhLVZIdiMkusMIMxWZWQtVSSQJpRNnh4DHC9hyislOYOwyDJ65_ZKQY5cNNARvSER93e3U23yB_NDEWbynhHweix2d9qfhko1cTIk1hRFymDYZw1c May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: d3a4bb3cecc4474e85a49a217fa98d9f May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-TestShelveInstance-1285321045 May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:43:50.258098 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:43:50.260408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3a4bb3cecc4474e85a49a217fa98d9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d3a4bb3cecc4474e85a49a217fa98d9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d3a4bb3cecc4474e85a49a217fa98d9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d3a4bb3cecc4474e85a49a217fa98d9f", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:43:50.260408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-TestShelveInstance-1285321045 May 19 12:43:50.260408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: d3a4bb3cecc4474e85a49a217fa98d9f May 19 12:43:50.260408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-TestShelveInstance-1285321045 May 19 12:43:50.260408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-TestShelveInstance-1285321045-project May 19 12:43:50.260408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:43:50.260408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:43:50.260408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 2273aeca59c04c778683e70665b7efa1 May 19 12:43:50.260408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-TestShelveInstance-1285321045-project May 19 12:43:50.260408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:43:50.260408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance 2beb7602-f905-4c4b-99cb-d09ed934c240 could not be found. May 19 12:43:50.260408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': '2beb7602-f905-4c4b-99cb-d09ed934c240'} May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2beb7602-f905-4c4b-99cb-d09ed934c240 could not be found. May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:43:50.261268 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2beb7602-f905-4c4b-99cb-d09ed934c240 could not be found. May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2beb7602-f905-4c4b-99cb-d09ed934c240 could not be found. May 19 12:43:50.262987 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:43:50.264636 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-54545d71-a4ef-4746-b27b-6a588957ef0d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Returning 404 to user: Instance 2beb7602-f905-4c4b-99cb-d09ed934c240 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:43:50.264636 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-54545d71-a4ef-4746-b27b-6a588957ef0d tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240" status: 404 len: 111 microversion: 2.1 time: 0.029830 May 19 12:43:50.264636 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 714/1341] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:43:50 2022] GET /compute/v2.1/servers/2beb7602-f905-4c4b-99cb-d09ed934c240 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:43:50.485968 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-b1c3e465-8653-4560-bbac-c88a1336ef15 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] Calling method '.version_select at 0x7fd45a860280>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:43:50.599311 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-b1c3e465-8653-4560-bbac-c88a1336ef15 tempest-TestShelveInstance-1285321045 tempest-TestShelveInstance-1285321045-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-224386898" status: 202 len: 0 microversion: 2.1 time: 0.117135 May 19 12:43:50.599898 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 628/1342] 10.222.0.57 () {58 vars in 1250 bytes} [Thu May 19 12:43:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-224386898 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:44:07.948044 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:44:07.948667 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Thu May 19 12:44:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:44:18.634032 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:44:18.634733 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Thu May 19 12:44:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:44:47.270600 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-00c57ba3-d616-4d5b-a603-44885c60b306 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:44:47.271241 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:44:47.271639 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-00c57ba3-d616-4d5b-a603-44885c60b306 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:44:47.271739 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG dbcounter [-] [118111] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118111) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:44:47.271831 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_api:SELECT=8 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:44:47.271831 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG dbcounter [-] [118112] Writing DB stats nova_cell1:SELECT=16 {{(pid=118112) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 12:44:47.273668 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-771e0944-a289-4d63-a545-3d9e1e97c283 req-a19e1129-ebc0-4339-b861-978526bc5c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8998364-4819-41a7-8bba-1c1513ed3b79", "tag": "679d8251-6e6d-4196-9c59-d5039983357d"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:44:47.276580 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-00c57ba3-d616-4d5b-a603-44885c60b306 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:47.277028 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-00c57ba3-d616-4d5b-a603-44885c60b306 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:47.277799 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-00c57ba3-d616-4d5b-a603-44885c60b306 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:47.278874 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-00c57ba3-d616-4d5b-a603-44885c60b306 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:47.285619 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-771e0944-a289-4d63-a545-3d9e1e97c283 req-a19e1129-ebc0-4339-b861-978526bc5c50 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:47.286182 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-771e0944-a289-4d63-a545-3d9e1e97c283 req-a19e1129-ebc0-4339-b861-978526bc5c50 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:47.298188 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-771e0944-a289-4d63-a545-3d9e1e97c283 req-a19e1129-ebc0-4339-b861-978526bc5c50 service nova] Creating event network-changed:679d8251-6e6d-4196-9c59-d5039983357d for instance b8998364-4819-41a7-8bba-1c1513ed3b79 on hv-cinder-77819 May 19 12:44:47.303897 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-771e0944-a289-4d63-a545-3d9e1e97c283 req-a19e1129-ebc0-4339-b861-978526bc5c50 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038111 May 19 12:44:47.304723 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-00c57ba3-d616-4d5b-a603-44885c60b306 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Going to try to terminate instance {{(pid=118112) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:44:47.304999 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 629/1343] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 12:44:47.607359 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-00c57ba3-d616-4d5b-a603-44885c60b306 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 204 len: 0 microversion: 2.1 time: 0.344620 May 19 12:44:47.608665 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 715/1344] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:44:47 2022] DELETE /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:44:47.617355 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-a810bb4f-cb28-4f8b-bd89-4d2b2d23c597 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:44:47.618060 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-a810bb4f-cb28-4f8b-bd89-4d2b2d23c597 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:44:47.625526 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a810bb4f-cb28-4f8b-bd89-4d2b2d23c597 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:47.625908 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a810bb4f-cb28-4f8b-bd89-4d2b2d23c597 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:47.627544 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a810bb4f-cb28-4f8b-bd89-4d2b2d23c597 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:47.627544 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-a810bb4f-cb28-4f8b-bd89-4d2b2d23c597 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:47.988413 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-a810bb4f-cb28-4f8b-bd89-4d2b2d23c597 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:44:47.996698 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-a810bb4f-cb28-4f8b-bd89-4d2b2d23c597 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1578 microversion: 2.1 time: 0.383826 May 19 12:44:47.997484 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 630/1345] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:44:47 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1578 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:44:49.016005 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2b6ec77c-3f8a-4942-99a4-092fd69abd91 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:44:49.016730 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2b6ec77c-3f8a-4942-99a4-092fd69abd91 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:44:49.023458 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b6ec77c-3f8a-4942-99a4-092fd69abd91 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:49.024303 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b6ec77c-3f8a-4942-99a4-092fd69abd91 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:49.024659 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b6ec77c-3f8a-4942-99a4-092fd69abd91 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:49.025706 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2b6ec77c-3f8a-4942-99a4-092fd69abd91 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:49.213892 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2b6ec77c-3f8a-4942-99a4-092fd69abd91 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:44:49.221594 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2b6ec77c-3f8a-4942-99a4-092fd69abd91 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1460 microversion: 2.1 time: 0.209769 May 19 12:44:49.222153 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 716/1346] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:44:49 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1460 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:44:49.910652 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-9e364ee3-935c-44e9-a542-143e1cb56c8c req-7093e8a6-5eae-4b3a-8738-0a168ea32209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8998364-4819-41a7-8bba-1c1513ed3b79", "name": "network-vif-deleted", "tag": "679d8251-6e6d-4196-9c59-d5039983357d"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:44:49.919907 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-9e364ee3-935c-44e9-a542-143e1cb56c8c req-7093e8a6-5eae-4b3a-8738-0a168ea32209 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:49.922947 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-9e364ee3-935c-44e9-a542-143e1cb56c8c req-7093e8a6-5eae-4b3a-8738-0a168ea32209 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:49.932641 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-9e364ee3-935c-44e9-a542-143e1cb56c8c req-7093e8a6-5eae-4b3a-8738-0a168ea32209 service nova] Creating event network-vif-deleted:679d8251-6e6d-4196-9c59-d5039983357d for instance b8998364-4819-41a7-8bba-1c1513ed3b79 on hv-cinder-77819 May 19 12:44:49.937559 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-9e364ee3-935c-44e9-a542-143e1cb56c8c req-7093e8a6-5eae-4b3a-8738-0a168ea32209 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030636 May 19 12:44:49.938136 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 631/1347] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:44:50.239157 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-2c75f102-3b12-4b31-8dba-d3bb5de4f39f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:44:50.240508 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-2c75f102-3b12-4b31-8dba-d3bb5de4f39f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:44:50.247506 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2c75f102-3b12-4b31-8dba-d3bb5de4f39f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:50.248059 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2c75f102-3b12-4b31-8dba-d3bb5de4f39f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:50.249047 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2c75f102-3b12-4b31-8dba-d3bb5de4f39f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:50.249488 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-2c75f102-3b12-4b31-8dba-d3bb5de4f39f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:50.320338 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-2c75f102-3b12-4b31-8dba-d3bb5de4f39f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:44:50.327909 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-2c75f102-3b12-4b31-8dba-d3bb5de4f39f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 200 len: 1226 microversion: 2.1 time: 0.093236 May 19 12:44:50.328495 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 717/1348] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:44:50 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:44:51.345918 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-29cb5881-fcce-4844-a19e-94e581041af4 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:44:51.346556 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-29cb5881-fcce-4844-a19e-94e581041af4 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: b8998364-4819-41a7-8bba-1c1513ed3b79] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:44:51.353307 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-29cb5881-fcce-4844-a19e-94e581041af4 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:51.353750 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-29cb5881-fcce-4844-a19e-94e581041af4 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:51.355702 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-29cb5881-fcce-4844-a19e-94e581041af4 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:51.356140 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-29cb5881-fcce-4844-a19e-94e581041af4 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:51.368957 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-29cb5881-fcce-4844-a19e-94e581041af4 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] HTTP exception thrown: Instance b8998364-4819-41a7-8bba-1c1513ed3b79 could not be found. May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-29cb5881-fcce-4844-a19e-94e581041af4 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Request method failure captured: May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 HTTP/1.1 May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjnIirHHZnrIqYsfsMtw9qDq7FQL0M8hN3eW2vaiUdExaVdwTuZ-haez21XavKiiPBmAyore_ws4OU8-aWtx3tIa4sc8o2KxAEokq1oYeS6zAkfV2Ymdn-TL-3raZ22DE9IXsbbcJ3mjlzZHvEUxdxcJzc5VPfzPcLHdUbUcM4GpM48 May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: ff5ebee4cf6c47f9adee30f9c8cd6ba1 May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-TestVolumeBootPattern-1730930557 May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:44:51.371070 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:44:51.372715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ff5ebee4cf6c47f9adee30f9c8cd6ba1", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:44:51.372715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-TestVolumeBootPattern-1730930557 May 19 12:44:51.372715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: ff5ebee4cf6c47f9adee30f9c8cd6ba1 May 19 12:44:51.372715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-TestVolumeBootPattern-1730930557 May 19 12:44:51.372715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-TestVolumeBootPattern-1730930557-project May 19 12:44:51.372715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:44:51.372715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:44:51.372715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 0beb4f30b5c34ab0afdbfbf46dbfede5 May 19 12:44:51.372715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-TestVolumeBootPattern-1730930557-project May 19 12:44:51.372715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:44:51.372715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance b8998364-4819-41a7-8bba-1c1513ed3b79 could not be found. May 19 12:44:51.372715 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': 'b8998364-4819-41a7-8bba-1c1513ed3b79'} May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8998364-4819-41a7-8bba-1c1513ed3b79 could not be found. May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:44:51.373602 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8998364-4819-41a7-8bba-1c1513ed3b79 could not be found. May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8998364-4819-41a7-8bba-1c1513ed3b79 could not be found. May 19 12:44:51.375239 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:51.382299 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-29cb5881-fcce-4844-a19e-94e581041af4 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Returning 404 to user: Instance b8998364-4819-41a7-8bba-1c1513ed3b79 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:44:51.382299 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-29cb5881-fcce-4844-a19e-94e581041af4 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79" status: 404 len: 111 microversion: 2.1 time: 0.030917 May 19 12:44:51.382299 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 632/1349] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:44:51 2022] GET /compute/v2.1/servers/b8998364-4819-41a7-8bba-1c1513ed3b79 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:44:54.723602 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-4ac24a0b-c363-4a2b-812c-27b113c5d7a5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:44:54.724120 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4ac24a0b-c363-4a2b-812c-27b113c5d7a5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:44:54.725563 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-5e4b6f4e-98dd-4f97-9a10-5fc5509bea97 req-354be6e5-d7e6-459a-8044-92e534ed7638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1656f0a-ef14-4881-ac85-33d7ee6aa9ef", "tag": "5ec83d31-72fc-40a7-abb0-4d6e27ee9f49"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:44:54.731096 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ac24a0b-c363-4a2b-812c-27b113c5d7a5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:54.731616 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ac24a0b-c363-4a2b-812c-27b113c5d7a5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:54.736942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ac24a0b-c363-4a2b-812c-27b113c5d7a5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:54.736942 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-4ac24a0b-c363-4a2b-812c-27b113c5d7a5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:54.737149 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-5e4b6f4e-98dd-4f97-9a10-5fc5509bea97 req-354be6e5-d7e6-459a-8044-92e534ed7638 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:54.737149 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-5e4b6f4e-98dd-4f97-9a10-5fc5509bea97 req-354be6e5-d7e6-459a-8044-92e534ed7638 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:54.747681 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-5e4b6f4e-98dd-4f97-9a10-5fc5509bea97 req-354be6e5-d7e6-459a-8044-92e534ed7638 service nova] Creating event network-changed:5ec83d31-72fc-40a7-abb0-4d6e27ee9f49 for instance f1656f0a-ef14-4881-ac85-33d7ee6aa9ef on hv-cinder-77819 May 19 12:44:54.753433 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-5e4b6f4e-98dd-4f97-9a10-5fc5509bea97 req-354be6e5-d7e6-459a-8044-92e534ed7638 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031435 May 19 12:44:54.754637 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 633/1350] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:44:54.761730 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-4ac24a0b-c363-4a2b-812c-27b113c5d7a5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Going to try to terminate instance {{(pid=118112) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 12:44:55.033764 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-4ac24a0b-c363-4a2b-812c-27b113c5d7a5 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 204 len: 0 microversion: 2.1 time: 0.313773 May 19 12:44:55.034335 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 718/1351] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:44:54 2022] DELETE /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 12:44:55.043297 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-46dce8df-cb3c-49ae-9bc5-3e7fc88530dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:44:55.043997 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-46dce8df-cb3c-49ae-9bc5-3e7fc88530dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:44:55.050315 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46dce8df-cb3c-49ae-9bc5-3e7fc88530dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:55.050799 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46dce8df-cb3c-49ae-9bc5-3e7fc88530dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:55.053322 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46dce8df-cb3c-49ae-9bc5-3e7fc88530dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:55.054157 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-46dce8df-cb3c-49ae-9bc5-3e7fc88530dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:55.194240 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.policy [None req-46dce8df-cb3c-49ae-9bc5-3e7fc88530dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118111) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:44:55.203043 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-46dce8df-cb3c-49ae-9bc5-3e7fc88530dc tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1578 microversion: 2.1 time: 0.164116 May 19 12:44:55.203725 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 634/1352] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:44:55 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:44:56.221499 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-bc127037-87a6-401c-8461-573d862e5047 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:44:56.222231 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-bc127037-87a6-401c-8461-573d862e5047 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:44:56.229408 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bc127037-87a6-401c-8461-573d862e5047 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:56.229668 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bc127037-87a6-401c-8461-573d862e5047 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:56.230291 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bc127037-87a6-401c-8461-573d862e5047 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:56.230767 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-bc127037-87a6-401c-8461-573d862e5047 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:56.549787 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-bc127037-87a6-401c-8461-573d862e5047 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:44:56.557654 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-bc127037-87a6-401c-8461-573d862e5047 tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1578 microversion: 2.1 time: 0.340769 May 19 12:44:56.558471 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 719/1353] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:44:56 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1578 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:44:57.300411 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [req-e21d04ea-a1ed-4e04-a71d-f9700472802b req-3c84d3f2-88b6-4981-a547-9b4ec66b4b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1656f0a-ef14-4881-ac85-33d7ee6aa9ef", "name": "network-vif-deleted", "tag": "5ec83d31-72fc-40a7-abb0-4d6e27ee9f49"}]} {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 12:44:57.311003 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-e21d04ea-a1ed-4e04-a71d-f9700472802b req-3c84d3f2-88b6-4981-a547-9b4ec66b4b34 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:57.311441 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [req-e21d04ea-a1ed-4e04-a71d-f9700472802b req-3c84d3f2-88b6-4981-a547-9b4ec66b4b34 service nova] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:57.322756 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.compute.server_external_events [req-e21d04ea-a1ed-4e04-a71d-f9700472802b req-3c84d3f2-88b6-4981-a547-9b4ec66b4b34 service nova] Creating event network-vif-deleted:5ec83d31-72fc-40a7-abb0-4d6e27ee9f49 for instance f1656f0a-ef14-4881-ac85-33d7ee6aa9ef on hv-cinder-77819 May 19 12:44:57.328649 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [req-e21d04ea-a1ed-4e04-a71d-f9700472802b req-3c84d3f2-88b6-4981-a547-9b4ec66b4b34 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031928 May 19 12:44:57.329218 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 635/1354] 10.222.0.57 () {64 vars in 1317 bytes} [Thu May 19 12:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 12:44:57.574715 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-39b6222c-df36-4085-9ec1-80005f79e0ef tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:44:57.575443 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-39b6222c-df36-4085-9ec1-80005f79e0ef tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:44:57.583148 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-39b6222c-df36-4085-9ec1-80005f79e0ef tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:57.583606 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-39b6222c-df36-4085-9ec1-80005f79e0ef tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:57.584388 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-39b6222c-df36-4085-9ec1-80005f79e0ef tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:57.584844 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-39b6222c-df36-4085-9ec1-80005f79e0ef tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:57.653225 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.policy [None req-39b6222c-df36-4085-9ec1-80005f79e0ef tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0beb4f30b5c34ab0afdbfbf46dbfede5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff5ebee4cf6c47f9adee30f9c8cd6ba1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118112) authorize /opt/stack/nova/nova/policy.py:199}} May 19 12:44:57.661350 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-39b6222c-df36-4085-9ec1-80005f79e0ef tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 200 len: 1225 microversion: 2.1 time: 0.090638 May 19 12:44:57.661974 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 720/1355] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:44:57 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 12:44:58.679479 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5457e7ee-40d2-4611-8260-46b54450533a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:44:58.680183 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-5457e7ee-40d2-4611-8260-46b54450533a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: f1656f0a-ef14-4881-ac85-33d7ee6aa9ef] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:44:58.687340 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5457e7ee-40d2-4611-8260-46b54450533a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:58.687795 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5457e7ee-40d2-4611-8260-46b54450533a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:58.688562 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5457e7ee-40d2-4611-8260-46b54450533a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:58.688998 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-5457e7ee-40d2-4611-8260-46b54450533a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:58.702322 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-5457e7ee-40d2-4611-8260-46b54450533a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] HTTP exception thrown: Instance f1656f0a-ef14-4881-ac85-33d7ee6aa9ef could not be found. May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5457e7ee-40d2-4611-8260-46b54450533a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Request method failure captured: May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef HTTP/1.1 May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjnIirHHZnrIqYsfsMtw9qDq7FQL0M8hN3eW2vaiUdExaVdwTuZ-haez21XavKiiPBmAyore_ws4OU8-aWtx3tIa4sc8o2KxAEokq1oYeS6zAkfV2Ymdn-TL-3raZ22DE9IXsbbcJ3mjlzZHvEUxdxcJzc5VPfzPcLHdUbUcM4GpM48 May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: ff5ebee4cf6c47f9adee30f9c8cd6ba1 May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-TestVolumeBootPattern-1730930557 May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:44:58.703959 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:44:58.705693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ff5ebee4cf6c47f9adee30f9c8cd6ba1", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:44:58.705693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-TestVolumeBootPattern-1730930557 May 19 12:44:58.705693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: ff5ebee4cf6c47f9adee30f9c8cd6ba1 May 19 12:44:58.705693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-TestVolumeBootPattern-1730930557 May 19 12:44:58.705693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-TestVolumeBootPattern-1730930557-project May 19 12:44:58.705693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:44:58.705693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:44:58.705693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 0beb4f30b5c34ab0afdbfbf46dbfede5 May 19 12:44:58.705693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-TestVolumeBootPattern-1730930557-project May 19 12:44:58.705693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:44:58.705693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance f1656f0a-ef14-4881-ac85-33d7ee6aa9ef could not be found. May 19 12:44:58.705693 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': 'f1656f0a-ef14-4881-ac85-33d7ee6aa9ef'} May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1656f0a-ef14-4881-ac85-33d7ee6aa9ef could not be found. May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:44:58.706592 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1656f0a-ef14-4881-ac85-33d7ee6aa9ef could not be found. May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1656f0a-ef14-4881-ac85-33d7ee6aa9ef could not be found. May 19 12:44:58.708010 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:58.709377 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-5457e7ee-40d2-4611-8260-46b54450533a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Returning 404 to user: Instance f1656f0a-ef14-4881-ac85-33d7ee6aa9ef could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:44:58.709377 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-5457e7ee-40d2-4611-8260-46b54450533a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef" status: 404 len: 111 microversion: 2.1 time: 0.030119 May 19 12:44:58.709377 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 636/1356] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:44:58 2022] GET /compute/v2.1/servers/f1656f0a-ef14-4881-ac85-33d7ee6aa9ef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:44:59.221980 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a25395d2-8b5b-4ecf-bb19-96e80d00a88f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:44:59.222536 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.compute.api [None req-a25395d2-8b5b-4ecf-bb19-96e80d00a88f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118112) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:44:59.228463 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a25395d2-8b5b-4ecf-bb19-96e80d00a88f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:59.228905 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a25395d2-8b5b-4ecf-bb19-96e80d00a88f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:59.230264 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a25395d2-8b5b-4ecf-bb19-96e80d00a88f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:59.230719 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG oslo_concurrency.lockutils [None req-a25395d2-8b5b-4ecf-bb19-96e80d00a88f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:59.243477 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.wsgi [None req-a25395d2-8b5b-4ecf-bb19-96e80d00a88f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] HTTP exception thrown: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a25395d2-8b5b-4ecf-bb19-96e80d00a88f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Request method failure captured: May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: request: DELETE /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 HTTP/1.1 May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept: application/json May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Accept-Encoding: identity May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Connection: close May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Length: 0 May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Content-Type: application/json May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Host: 10.222.0.57 May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Openstack-System-Scope: None May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: User-Agent: python-urllib3/1.26.9 May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Auth-Token: gAAAAABihjnIirHHZnrIqYsfsMtw9qDq7FQL0M8hN3eW2vaiUdExaVdwTuZ-haez21XavKiiPBmAyore_ws4OU8-aWtx3tIa4sc8o2KxAEokq1oYeS6zAkfV2Ymdn-TL-3raZ22DE9IXsbbcJ3mjlzZHvEUxdxcJzc5VPfzPcLHdUbUcM4GpM48 May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Id: None May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Domain-Name: None May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Identity-Status: Confirmed May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Is-Admin-Project: True May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Id: default May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Domain-Name: Default May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Id: ff5ebee4cf6c47f9adee30f9c8cd6ba1 May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Project-Name: tempest-TestVolumeBootPattern-1730930557 May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Role: reader,member May 19 12:44:59.245082 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Roles: reader,member May 19 12:44:59.247584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ff5ebee4cf6c47f9adee30f9c8cd6ba1", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:44:59.247584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant: tempest-TestVolumeBootPattern-1730930557 May 19 12:44:59.247584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Id: ff5ebee4cf6c47f9adee30f9c8cd6ba1 May 19 12:44:59.247584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-Tenant-Name: tempest-TestVolumeBootPattern-1730930557 May 19 12:44:59.247584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User: tempest-TestVolumeBootPattern-1730930557-project May 19 12:44:59.247584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Id: default May 19 12:44:59.247584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Domain-Name: Default May 19 12:44:59.247584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Id: 0beb4f30b5c34ab0afdbfbf46dbfede5 May 19 12:44:59.247584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: X-User-Name: tempest-TestVolumeBootPattern-1730930557-project May 19 12:44:59.247584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: method: > May 19 12:44:59.247584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: exception: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:44:59.247584 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: action_args: {'id': 'e5e64393-40c8-4218-b12d-e1fa8c7e9482'} May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:44:59.248578 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:44:59.250155 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: ERROR nova.api.openstack.wsgi May 19 12:44:59.251859 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-a25395d2-8b5b-4ecf-bb19-96e80d00a88f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Returning 404 to user: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. {{(pid=118112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:44:59.251859 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-a25395d2-8b5b-4ecf-bb19-96e80d00a88f tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "DELETE /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 404 len: 111 microversion: 2.1 time: 0.029105 May 19 12:44:59.251859 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 721/1357] 10.222.0.57 () {58 vars in 1238 bytes} [Thu May 19 12:44:59 2022] DELETE /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 12:44:59.255346 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-eec02649-965c-43ae-89b3-0afd2d6d6e1a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '>' {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:44:59.255949 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.compute.api [None req-eec02649-965c-43ae-89b3-0afd2d6d6e1a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] [instance: e5e64393-40c8-4218-b12d-e1fa8c7e9482] Fetching instance by UUID {{(pid=118111) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 12:44:59.262253 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eec02649-965c-43ae-89b3-0afd2d6d6e1a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:59.262729 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eec02649-965c-43ae-89b3-0afd2d6d6e1a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:59.263474 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eec02649-965c-43ae-89b3-0afd2d6d6e1a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 12:44:59.263903 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG oslo_concurrency.lockutils [None req-eec02649-965c-43ae-89b3-0afd2d6d6e1a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Lock "265c6b0e-6307-4ee8-8365-0ad79f4145cf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 12:44:59.277065 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.wsgi [None req-eec02649-965c-43ae-89b3-0afd2d6d6e1a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] HTTP exception thrown: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-eec02649-965c-43ae-89b3-0afd2d6d6e1a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Request method failure captured: May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: request: GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 HTTP/1.1 May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept: application/json May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Accept-Encoding: identity May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Connection: close May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Length: 0 May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Content-Type: application/json May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Host: 10.222.0.57 May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Openstack-System-Scope: None May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: User-Agent: python-urllib3/1.26.9 May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Auth-Token: gAAAAABihjnIirHHZnrIqYsfsMtw9qDq7FQL0M8hN3eW2vaiUdExaVdwTuZ-haez21XavKiiPBmAyore_ws4OU8-aWtx3tIa4sc8o2KxAEokq1oYeS6zAkfV2Ymdn-TL-3raZ22DE9IXsbbcJ3mjlzZHvEUxdxcJzc5VPfzPcLHdUbUcM4GpM48 May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Id: None May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Domain-Name: None May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Identity-Status: Confirmed May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Is-Admin-Project: True May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Id: default May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Domain-Name: Default May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Id: ff5ebee4cf6c47f9adee30f9c8cd6ba1 May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Project-Name: tempest-TestVolumeBootPattern-1730930557 May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Role: reader,member May 19 12:44:59.278598 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Roles: reader,member May 19 12:44:59.280273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ff5ebee4cf6c47f9adee30f9c8cd6ba1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ff5ebee4cf6c47f9adee30f9c8cd6ba1", "adminURL": "http://10.222.0.57:8080"}]}] May 19 12:44:59.280273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant: tempest-TestVolumeBootPattern-1730930557 May 19 12:44:59.280273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Id: ff5ebee4cf6c47f9adee30f9c8cd6ba1 May 19 12:44:59.280273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-Tenant-Name: tempest-TestVolumeBootPattern-1730930557 May 19 12:44:59.280273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User: tempest-TestVolumeBootPattern-1730930557-project May 19 12:44:59.280273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Id: default May 19 12:44:59.280273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Domain-Name: Default May 19 12:44:59.280273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Id: 0beb4f30b5c34ab0afdbfbf46dbfede5 May 19 12:44:59.280273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: X-User-Name: tempest-TestVolumeBootPattern-1730930557-project May 19 12:44:59.280273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: method: > May 19 12:44:59.280273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: exception: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:44:59.280273 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: action_args: {'id': 'e5e64393-40c8-4218-b12d-e1fa8c7e9482'} May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: {{(pid=118111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 12:44:59.281139 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. May 19 12:44:59.282521 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: ERROR nova.api.openstack.wsgi May 19 12:44:59.283859 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: DEBUG nova.api.openstack.wsgi [None req-eec02649-965c-43ae-89b3-0afd2d6d6e1a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Returning 404 to user: Instance e5e64393-40c8-4218-b12d-e1fa8c7e9482 could not be found. {{(pid=118111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 12:44:59.283859 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO nova.api.openstack.requestlog [None req-eec02649-965c-43ae-89b3-0afd2d6d6e1a tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482" status: 404 len: 111 microversion: 2.1 time: 0.028309 May 19 12:44:59.283859 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: [pid: 118111|app: 0|req: 637/1358] 10.222.0.57 () {58 vars in 1235 bytes} [Thu May 19 12:44:59 2022] GET /compute/v2.1/servers/e5e64393-40c8-4218-b12d-e1fa8c7e9482 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 12:45:00.838380 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: DEBUG nova.api.openstack.wsgi [None req-43d3daa6-0930-46e0-a03c-7d7b2c8742da tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] Calling method '.version_select at 0x7fd455539040>' {{(pid=118112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 12:45:00.923460 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO nova.api.openstack.requestlog [None req-43d3daa6-0930-46e0-a03c-7d7b2c8742da tempest-TestVolumeBootPattern-1730930557 tempest-TestVolumeBootPattern-1730930557-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1443882366" status: 202 len: 0 microversion: 2.1 time: 0.088966 May 19 12:45:00.924041 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: [pid: 118112|app: 0|req: 722/1359] 10.222.0.57 () {58 vars in 1262 bytes} [Thu May 19 12:45:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1443882366 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 12:47:27.956499 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:47:27.957156 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Thu May 19 12:47:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:47:38.642624 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:47:38.643445 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Thu May 19 12:47:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:47:50.703417 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:47:50.703962 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Thu May 19 12:47:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:47:59.827068 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:47:59.827620 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Thu May 19 12:47:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:48:08.355992 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:48:08.356611 dv-cinder-778193-27-iscsi devstack@n-api.service[118112]: Thu May 19 12:48:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 12:49:17.531772 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 12:49:17.532503 dv-cinder-778193-27-iscsi devstack@n-api.service[118111]: Thu May 19 12:49:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!